oracle.spatial.hadoop.vector.mapreduce.input

Class SpatialIndexInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<org.apache.hadoop.io.Text,RecordInfo>

oracle.spatial.hadoop.vector.mapreduce.input.SpatialIndexInputFormat

public class SpatialIndexInputFormat
extends org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<org.apache.hadoop.io.Text,RecordInfo>

InputFormat for reading a Spatial Index generated with the Vector API.
This class delivers the records stored into the index as Text/RecordInfo key/value pairs instead of returning the whole RTreeWritable value.
Additionally, a spatial filter can be performed over the input data set; to do that, it is needed to specify a SpatialOperationConfig.
If required, an InputFormat-specific SpatialOperationConfig can be configured to be used only by this InputFormat by calling setFilterSpatialOperationConfig(SpatialOperationConfig, Configuration).
If no spatial operation configuration is defined, a SpatialOperation.AnyInteract will be performed taking as query window the boundaries defined in the SpatialConfig (if any).

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<org.apache.hadoop.io.Text,RTreeWritable>	internalInputFormat

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

Constructor Summary

Constructors

Constructor and Description
SpatialIndexInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,RecordInfo>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
static SpatialOperationConfig	getFilterSpatialOperationConfig(org.apache.hadoop.conf.Configuration conf) Gets the SpatialOperationConfig used to filter records for the given job's configuration.
static SpatialOperationConfig	getFilterSpatialOperationConfig(java.lang.Integer dataSetId, org.apache.hadoop.conf.Configuration conf) Gets the SpatialOperationConfig used to filter records for the given job's configuration and data set.
static void	setFilterSpatialOperationConfig(SpatialOperationConfig spatialOpConf, org.apache.hadoop.conf.Configuration conf) Sets an input-format specific SpatialOperationConfig.
static void	setFilterSpatialOperationConfig(SpatialOperationConfig spatialOpConf, java.lang.Integer dataSetId, org.apache.hadoop.conf.Configuration conf) Sets an input-format-dataset specific SpatialOperationConfig.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat

getFormatMinSplitSize, listStatus

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, isSplitable, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

internalInputFormat

protected org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<org.apache.hadoop.io.Text,RTreeWritable> internalInputFormat

Constructor Detail

SpatialIndexInputFormat

public SpatialIndexInputFormat()

Method Detail

setFilterSpatialOperationConfig

public static void setFilterSpatialOperationConfig(SpatialOperationConfig spatialOpConf,
                                                   org.apache.hadoop.conf.Configuration conf)

Sets an input-format specific SpatialOperationConfig.

Parameters:

spatialOpConf - a spatial operation configuration defining how the data should be spatially filtered.

conf - the job's configuration.

setFilterSpatialOperationConfig

public static void setFilterSpatialOperationConfig(SpatialOperationConfig spatialOpConf,
                                                   java.lang.Integer dataSetId,
                                                   org.apache.hadoop.conf.Configuration conf)

Sets an input-format-dataset specific SpatialOperationConfig. Used when there are multiple input data sets that use SpatialIndexInputFormat with different filter requirements.

Parameters:

spatialOpConf - a spatial operation configuration defining how the data should be spatially filtered.

dataSetId - the data set id as assigned by MultipleInputsConfig

conf - the job's configuration

getFilterSpatialOperationConfig

public static SpatialOperationConfig getFilterSpatialOperationConfig(org.apache.hadoop.conf.Configuration conf)

Gets the SpatialOperationConfig used to filter records for the given job's configuration.

Parameters:

conf - the job configuration.

Returns:

a SpatialOperationConfig instance

getFilterSpatialOperationConfig

public static SpatialOperationConfig getFilterSpatialOperationConfig(java.lang.Integer dataSetId,
                                                                     org.apache.hadoop.conf.Configuration conf)

Gets the SpatialOperationConfig used to filter records for the given job's configuration and data set.

Parameters:

dataSetId - the data set id as assigned by MultipleInputsConfig

conf - the job configuration

Returns:

a SpatialOperationConfig instance

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,RecordInfo> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                         org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                  throws java.io.IOException

Overrides:

createRecordReader in class org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<org.apache.hadoop.io.Text,RecordInfo>

Throws:

java.io.IOException