oracle.spatial.hadoop.vector.mapred.input

Class FileSplitInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

oracle.spatial.hadoop.vector.mapred.input.CompositeInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>

oracle.spatial.hadoop.vector.mapred.input.FileSplitInputFormat

All Implemented Interfaces:

AbstractCompositeInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>, org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>, org.apache.hadoop.mapred.JobConfigurable

Direct Known Subclasses:

MultipleInputsFileSplitInputFormat

public class FileSplitInputFormat
extends CompositeInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>
implements org.apache.hadoop.mapred.JobConfigurable

A CompositeInputFormat that only provides the source FileSplits as its values so mapreduce components can read the data directly using its internal input format.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields inherited from class oracle.spatial.hadoop.vector.mapred.input.CompositeInputFormat

iInputFormat

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
FileSplitInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapred.JobConf conf)
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>	getDelegateRecordReader(org.apache.hadoop.mapred.FileSplit split, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter) Creates a record reader instance.

Methods inherited from class oracle.spatial.hadoop.vector.mapred.input.CompositeInputFormat

getFittingInputSplit, getInternalInputFormat, getInternalInputFormatClass, getRecordInfoProvider, getRecordInfoProviderClass, getRecordReader, getSplits, setInternalInputFormatClass, setRecordInfoProviderClass

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileSplitInputFormat

public FileSplitInputFormat()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf conf)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

Overrides:

configure in class CompositeInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>

getDelegateRecordReader

public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit> getDelegateRecordReader(org.apache.hadoop.mapred.FileSplit split,
                                                                                                                                  org.apache.hadoop.mapred.JobConf conf,
                                                                                                                                  org.apache.hadoop.mapred.Reporter reporter)
                                                                                                                                    throws java.io.IOException

Description copied from class: CompositeInputFormat

Creates a record reader instance. The returned record instance can be a wrapper of the internalInputFormat's record reader. This method is called after getRecordReader(). If the internalInputFormat is a CombineFileInputFormat subclass, this method can be called as many times as paths are contained in the CombineFileSplits.

Specified by:

getDelegateRecordReader in class CompositeInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.mapred.FileSplit>

Parameters:

split - a FileSplit instance

conf - the job configuration

reporter - a Reporter instance

Returns:

a RecordReader instance.

Throws:

java.io.IOException