oracle.spatial.hadoop.vector.mapred.input

Class AdapterInputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

oracle.spatial.hadoop.vector.mapred.input.AdapterInputFormat<K,V>

Type Parameters:

K - The type of the internalInputFormat's keys

V - The type of the internalInputFormat's values

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<K,V>, org.apache.hadoop.mapred.JobConfigurable

public class AdapterInputFormat<K,V>
extends org.apache.hadoop.mapred.FileInputFormat<K,V>
implements org.apache.hadoop.mapred.JobConfigurable

This input format works as an adapter for subclasses of the new API' org.apache.hadoop.mapreduce.lib.input.FileInputFormat

The internal InputFormat class must be set using the static method AdapterInputFormat#setInternalInputFormatClass(JobConf, Class)

Note that when using a new API' InputFormat with SpatialIndexingMapper it will be not possible to get the start position for each record so the index' entries will not contain the record pointer information (offset and length).

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	NEW_INPUT_FORMAT

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
AdapterInputFormat()

Method Summary

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapred.JobConf conf)
org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>	getInternalInputFormat(org.apache.hadoop.mapred.JobConf conf) Gets an instance of the class set as the internal input format
static <K,V> java.lang.Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>>	getInternalInputFormatClass(org.apache.hadoop.mapred.JobConf conf) Gets the internal input format type which is used to actually read the data.
org.apache.hadoop.mapred.RecordReader<K,V>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter)
org.apache.hadoop.mapred.InputSplit[]	getSplits(org.apache.hadoop.mapred.JobConf conf, int arg1)
static <K,V> void	setInternalInputFormatClass(org.apache.hadoop.mapred.JobConf conf, java.lang.Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>> inputFormatClass) Sets the internal input format type which is used to actually read the data.

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NEW_INPUT_FORMAT

public static final java.lang.String NEW_INPUT_FORMAT

See Also:

Constant Field Values

Constructor Detail

AdapterInputFormat

public AdapterInputFormat()

Method Detail

setInternalInputFormatClass

public static <K,V> void setInternalInputFormatClass(org.apache.hadoop.mapred.JobConf conf,
                                                     java.lang.Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>> inputFormatClass)

Sets the internal input format type which is used to actually read the data.

Parameters:

conf - the job configuration

inputFormatClass - a class of type org.apache.hadoop.mapreduce.lib.input.FileInputFormat

getInternalInputFormatClass

public static <K,V> java.lang.Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>> getInternalInputFormatClass(org.apache.hadoop.mapred.JobConf conf)

Gets the internal input format type which is used to actually read the data.

Parameters:

conf - the job configuration

Returns:

a class of type org.apache.hadoop.mapreduce.lib.input.FileInputFormat

getInternalInputFormat

public org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> getInternalInputFormat(org.apache.hadoop.mapred.JobConf conf)

Gets an instance of the class set as the internal input format

Parameters:

conf - the job configuration

Returns:

an org.apache.hadoop.mapreduce.lib.input.FileInputFormat instance

configure

public void configure(org.apache.hadoop.mapred.JobConf conf)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

getRecordReader

public org.apache.hadoop.mapred.RecordReader<K,V> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                  org.apache.hadoop.mapred.JobConf conf,
                                                                  org.apache.hadoop.mapred.Reporter reporter)
                                                           throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<K,V>

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<K,V>

Throws:

java.io.IOException

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf conf,
                                                       int arg1)
                                                throws java.io.IOException

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<K,V>

Overrides:

getSplits in class org.apache.hadoop.mapred.FileInputFormat<K,V>

Throws:

java.io.IOException