oracle.spatial.hadoop.vector.mapreduce.job

Class SpatialJoin

java.lang.Object

org.apache.hadoop.conf.Configured

oracle.spatial.hadoop.vector.mapred.job.BaseJob<java.lang.Object,java.lang.Object>

oracle.spatial.hadoop.vector.mapred.job.MultipleInputsJob

oracle.spatial.hadoop.vector.mapred.job.SpatialJoin

oracle.spatial.hadoop.vector.mapreduce.job.SpatialJoin

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class SpatialJoin
extends SpatialJoin

This class can be used to run or configure a job for joining pairs of records from different data sets based on a spatial interaction between records.
A partitioning result file as generated by Partitioning is required to perform the spatial join. A spatial join can be executed as follows:

1. Create a SpatialJoin instance
2. Set the input parameters such as input data sets, output path and optionally a partitioning result file path.
3. Call preprocess(Job)
4. Call configure(Job)
5. Run the job.

Note that if a partitioning result file path is not set, partitioning is performed when calling SpatialJoin.preprocess(JobConf).

Field Summary

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.SpatialJoin

JOIN_FOLDER, PARTITIONING_FOLDER, partitioningResultPath, samplingRatio, spatialOperationConfig

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.MultipleInputsJob

inputDataSets, miConf

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.BaseJob

argsp, inputDataSet, jarClass, jobRegEntryPath, proxyIDS

Constructor Summary

Constructors

Constructor and Description
SpatialJoin()

Method Summary

Methods

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapreduce.Job job) Validates and adds the current parameters to the job configuration
protected InputDataSetConfiguratorHandler	getInputDataSetConfiguratorHandler(org.apache.hadoop.conf.Configuration conf) Returns the current instance of InputDataSetConfiguratorHandler used to configure the input data set
static void	main(java.lang.String[] args)
boolean	preprocess(org.apache.hadoop.mapreduce.Job job)
int	run(java.lang.String[] args)

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.SpatialJoin

configure, defineGlobaBounds, getCmdOptions, getCurrentCmdArgs, getInputDataSetCmdParserHandler, getOutput, getPartitioningResultPath, getRootOutput, getSamplingRatio, getSpatialOperationConfig, isPartitioningRequired, preprocess, processArgs, setPartitioningResultPath, setSamplingRatio, setSpatialOperationConfig, setupPartitioningResult

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.MultipleInputsJob

addInputDataSet, asMultiInputDataSet, configureInputs, configureInputs, getInputListCmdOptions, getInputs, getMultipleInputDataSetsParams, removeInputDataSet, setInputDataSets, updateInputDataSet

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.BaseJob

addJobRegistryEntry, addJobRegistryEntry, addJobRegistryEntry, createJob, createJob, createJob, createJob, createJobConf, createJobConf, createJobConf, getCmdOptionsWithInputDataSets, getCmdOptionsWithInputDataSets, getCurrentCmdArgsAsString, getCurrentCmdArgsAsString, getInput, getInputDataSet, getInputFormatClass, getJarClass, getRecordInfoProviderClass, getSpatialConfig, runJob, runJob, setInput, setInputDataSet, setInputFormatClass, setJarClass, setOutput, setRecordInfoProviderClass, setSpatialConfig

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

SpatialJoin

public SpatialJoin()

Method Detail

getInputDataSetConfiguratorHandler

protected InputDataSetConfiguratorHandler getInputDataSetConfiguratorHandler(org.apache.hadoop.conf.Configuration conf)

Description copied from class: BaseJob

Returns the current instance of InputDataSetConfiguratorHandler used to configure the input data set

Overrides:

getInputDataSetConfiguratorHandler in class SpatialJoin

Parameters:

conf - a job configuration

Returns:

an instance of InputDataSetConfiguratorHandler

configure

public void configure(org.apache.hadoop.mapreduce.Job job)
               throws java.lang.Exception

Description copied from class: BaseJob

Validates and adds the current parameters to the job configuration

Overrides:

configure in class BaseJob<java.lang.Object,java.lang.Object>

Parameters:

job - a job instance

Throws:

java.lang.Exception

preprocess

public boolean preprocess(org.apache.hadoop.mapreduce.Job job)
                   throws java.lang.Exception

Throws:

java.lang.Exception

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Overrides:

run in class SpatialJoin

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception