oracle.spatial.hadoop.vector.mapreduce.input

Class SpatialFilterInputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<I,J>

oracle.spatial.hadoop.vector.mapreduce.input.WrapperInputFormat<K,V,K,V>

oracle.spatial.hadoop.vector.mapreduce.input.SpatialFilterInputFormat<K,V>

Type Parameters:

K - The type of the keys

V - The type of the values

All Implemented Interfaces:

oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialFilterContext<K,V>

public class SpatialFilterInputFormat<K,V>
extends WrapperInputFormat<K,V,K,V>
implements oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialFilterContext<K,V>

An implementation of WrapperInputFormat that is capable of spatially filter records returned by an internal input format.
In order to perform a spatial filter, a SpatialOperationConfig must be configured in the current job.
A previously generated spatial index can be used to filter the data by adding the spatial index map file to the distributed cache and setting the index name in the job configuration as ConfigParams.SPATIAL_INDEX_NAME or setting the spatial index location the job configuration as ConfigParams.SPATIAL_INDEX_LOCATION.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CONF_INPUT_FORMAT_FILTER_READERS

Fields inherited from class oracle.spatial.hadoop.vector.mapreduce.input.WrapperInputFormat

iInputFormat

Constructor Summary

Constructors

Constructor and Description
SpatialFilterInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<K,V>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>	getInputFormat()
RecordInfoProvider<K,V>	getRecordInfoProvider()
oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialIndexSplitFilter	getSpatiallyIndexedSplitFilter()
SpatialOperationConfig	getSpatialOperationConfig()
protected void	loadInputFormatFilterReaders(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class oracle.spatial.hadoop.vector.mapreduce.input.WrapperInputFormat

createInternalInputFormat, getFittingInputSplit, getInternalInputFormat, getInternalInputFormatClass, getRecordInfoProvider, getRecordInfoProviderClass, getSplits, setInternalInputFormatClass, setRecordInfoProviderClass

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONF_INPUT_FORMAT_FILTER_READERS

public static final java.lang.String CONF_INPUT_FORMAT_FILTER_READERS

See Also:

Constant Field Values

Constructor Detail

SpatialFilterInputFormat

public SpatialFilterInputFormat()

Method Detail

loadInputFormatFilterReaders

protected void loadInputFormatFilterReaders(org.apache.hadoop.conf.Configuration conf)

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<K,V> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                        org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                 throws java.io.IOException,
                                                                        java.lang.InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<K,V>

Throws:

java.io.IOException

java.lang.InterruptedException

getSpatiallyIndexedSplitFilter

public oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialIndexSplitFilter getSpatiallyIndexedSplitFilter()

Specified by:

getSpatiallyIndexedSplitFilter in interface oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialFilterContext<K,V>

getRecordInfoProvider

public RecordInfoProvider<K,V> getRecordInfoProvider()

Specified by:

getRecordInfoProvider in interface oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialFilterContext<K,V>

getSpatialOperationConfig

public SpatialOperationConfig getSpatialOperationConfig()

Specified by:

getSpatialOperationConfig in interface oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialFilterContext<K,V>

getInputFormat

public org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V> getInputFormat()

Specified by:

getInputFormat in interface oracle.spatial.hadoop.vector.mapreduce.input.filter.SpatialFilterContext<K,V>