oracle.spatial.hadoop.vector.mapred

Class AbstractSpatialHierarchicalMapper<K,V,W>

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

oracle.spatial.hadoop.vector.mapred.AbstractSpatialHierarchicalMapper<K,V,W>

Type Parameters:

K - The type of the internalInputFormat's keys

V - The type of the internalInputFormat's values

W - The type of the output value

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.Text,RTreeWritable,org.apache.hadoop.io.Text,W>

Direct Known Subclasses:

SpatialHierarchicalCountMapper, SpatialHierarchicalJoinMapper

public abstract class AbstractSpatialHierarchicalMapper<K,V,W>
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.Text,RTreeWritable,org.apache.hadoop.io.Text,W>

Base mapper class used to catalog records into hierarchy layers. Records are cataloged using a spatial operation between the record's geometry and the geometries of the hierarchical entities.

The input data is always expected to be a spatial index as generated by SpatialIndexingMapper

The output key is a combination of a hierarchy layer's name and one of the id of one of the hierarchy level's entities. The value must be defined by the implementing class

The search always starts from the bottom level of the hierarchy, that is, the maximum hierarchy level. As matches are found, the counts are propagated to the parents in upper levels. By default, only the bottom level entries are searched in the spatial index, however, by setting to true the parameter ConfigParams.HIERARCHY_SEARCH_MULTIPLE_LEVELS it is possible to continue searching in upper hierarchies until all the elements in the index are cataloged.

Expected configuration:

• ConfigParams.HIERARCHY_INFO_CLASS
• ConfigParams.HIERARCHY_LOAD_MIN_LEVEL - optional
• ConfigParams.HIERARCHY_LOAD_MAX_LEVEL - optional
• ConfigParams.HIERARCHY_SEARCH_MULTIPLE_LEVELS - optional
• ConfigParams.SPATIAL_OPERATION
• ConfigParams.SRID
• ConfigParams.SPATIAL_TOLERANCE - optional
• ConfigParams.GEODETIC

Field Summary

Fields

Modifier and Type	Field and Description
protected HierarchyInfo	hierInfo
protected int	maxLevel
protected int	minLevel
protected org.apache.hadoop.io.Text	outKey
protected boolean	searchMultiLevels
protected SpatialOperationConfig	spatialOpConf

Constructor Summary

Constructors

Constructor and Description
AbstractSpatialHierarchicalMapper()

Method Summary

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapred.JobConf conf)
protected abstract W	getOutValue(RecordInfo matchingRecordInfo) Given a RecordInfo instance representing a record that previously matched a hierarchy entry, returns the output value
void	map(org.apache.hadoop.io.Text key, RTreeWritable value, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,W> output, org.apache.hadoop.mapred.Reporter reporter)
protected void	mapHierarchicalResults(java.lang.String featureId, int level, W outValue, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,W> output, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class org.apache.hadoop.mapred.MapReduceBase

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Field Detail

outKey

protected org.apache.hadoop.io.Text outKey

spatialOpConf

protected SpatialOperationConfig spatialOpConf

hierInfo

protected HierarchyInfo hierInfo

searchMultiLevels

protected boolean searchMultiLevels

maxLevel

protected int maxLevel

minLevel

protected int minLevel

Constructor Detail

AbstractSpatialHierarchicalMapper

public AbstractSpatialHierarchicalMapper()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf conf)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

Overrides:

configure in class org.apache.hadoop.mapred.MapReduceBase

map

public void map(org.apache.hadoop.io.Text key,
                RTreeWritable value,
                org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,W> output,
                org.apache.hadoop.mapred.Reporter reporter)
         throws java.io.IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.Text,RTreeWritable,org.apache.hadoop.io.Text,W>

Throws:

java.io.IOException

getOutValue

protected abstract W getOutValue(RecordInfo matchingRecordInfo)

Given a RecordInfo instance representing a record that previously matched a hierarchy entry, returns the output value

Parameters:

matchingRecordInfo - an instance of RecordInfo

Returns:

a value used as the output value

mapHierarchicalResults

protected void mapHierarchicalResults(java.lang.String featureId,
                                      int level,
                                      W outValue,
                                      org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,W> output,
                                      org.apache.hadoop.mapred.Reporter reporter)
                               throws java.io.IOException

Throws:

java.io.IOException