Notice: This website is an unofficial Microsoft Knowledge Base (hereinafter KB) archive and is intended to provide a reliable access to deleted content from Microsoft KB. All KB articles are owned by Microsoft Corporation. Read full disclaimer for more details.

When writing out predictions to XDF files in HDFS, why are results returned in metadata folder?


View products that this article applies to.

You should think of both the data and metadata folders and all of the composite XDF files stored in Hadoop in the 'data' folder 
as really all of the information for a single XDF output file. In Hadoop we create a set of composite XDF files(you will see files 
with name (*.xdfm) in the data folder. The metadata folder contains footer information for the XDF file such as number of variables, etc 
that is needed for fast file access.

The reason we store XDF files in Hadoop this way is for fast file access and to take advantage of HDFS block sizes. 
You will need to store the results from rxPredict() as a composite XDf file in Hadoop or as a composite CSV file in HDFS.

↑ Back to the top


Keywords: kb

↑ Back to the top

Article Info
Article ID : 3104123
Revision : 1
Created on : 1/7/2017
Published on : 10/31/2015
Exists online : False
Views : 63