oracle.spatial.hadoop.vector.mapreduce.job

Class Partitioning

java.lang.Object

org.apache.hadoop.conf.Configured

oracle.spatial.hadoop.vector.mapred.job.BaseJob<java.lang.Object,java.lang.Object>

oracle.spatial.hadoop.vector.mapred.job.MultipleInputsJob

oracle.spatial.hadoop.vector.mapred.job.Partitioning

oracle.spatial.hadoop.vector.mapreduce.job.Partitioning

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class Partitioning
extends Partitioning

This class can be used to run or configure a job for spatially partitioning one or more data sets.
Partitioning can be performed using only a fraction of the input data size by setting the Partitioning.setSamplingRatio(double) property (by default it is set to 0.1).
The job's output is a partitioning file, a GeoJSON file containing the generated partitions with information such as the partition geometry and number of elements in the partition.

Field Summary

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.Partitioning

PARTITION_RESULT_FILE, samplingRatio

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.MultipleInputsJob

inputDataSets, miConf

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.BaseJob

argsp, jarClass

Constructor Summary

Constructors

Constructor and Description
Partitioning()

Method Summary

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapreduce.Job job)
static void	main(java.lang.String[] args)
int	run(java.lang.String[] args)
boolean	runFullPartitioningProcess(org.apache.hadoop.mapreduce.Job job) Runs the full partitioning process.

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.Partitioning

configure, defineGlobaBounds, getCmdOptions, getPathsLength, getSamplePath, getSamplingRatio, processArgs, runFullPartitioningProcess, setSamplingRatio

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.MultipleInputsJob

addInputDataSet, configureInputs, configureInputs, getInputListCmdOptions, getInputs, getMultipleInputDataSetsParams, removeInputDataSet, setInputDataSets

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.BaseJob

createJob, createJob, createJob, createJob, createJobConf, createJobConf, createJobConf, getInput, getInputFormatClass, getJarClass, getOutput, getRecordInfoProviderClass, getSpatialConfig, setInput, setInputFormatClass, setJarClass, setOutput, setRecordInfoProviderClass, setSpatialConfig

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

Partitioning

public Partitioning()

Method Detail

configure

public void configure(org.apache.hadoop.mapreduce.Job job)
               throws java.lang.Exception

Overrides:

configure in class MultipleInputsJob

Throws:

java.lang.Exception

runFullPartitioningProcess

public boolean runFullPartitioningProcess(org.apache.hadoop.mapreduce.Job job)
                                   throws java.lang.Exception

Runs the full partitioning process. It is not needed to call configure() when calling this method

Parameters:

job - a job

Returns:

true if the job finished successfully

Throws:

java.lang.Exception

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Overrides:

run in class Partitioning

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception