oracle.spatial.hadoop.vector.mapred.job

Class Categorization<K,V>

java.lang.Object

org.apache.hadoop.conf.Configured

oracle.spatial.hadoop.vector.mapred.job.BaseJob<K,V>

oracle.spatial.hadoop.vector.mapred.job.IndexedInputBaseJob<K,V>

oracle.spatial.hadoop.vector.mapred.job.Categorization<K,V>

Type Parameters:

K - the type of the input keys

V - the type of the input values

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

Direct Known Subclasses:

Categorization

public class Categorization<K,V>
extends IndexedInputBaseJob<K,V>

This class can be used to run or configure a job for categorizing records of an input dataset into features of a hierarchical dataset.

The result will be a summary file for each hierarchical level containing the number of records from the non-hierarchical dataset per hierarchy level feature.

The categorization can be performed determining a spatial interaction specified by a spatial operation or using MVSuggest.

Field Summary

Fields

Modifier and Type	Field and Description
protected MVSService	mvsService

Fields inherited from class oracle.spatial.hadoop.vector.mapred.job.BaseJob

argsp, jarClass

Constructor Summary

Constructors

Constructor and Description
Categorization()

Method Summary

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapred.JobConf conf) Validates and adds the current parameters to the job configuration
java.lang.String	getCmdOptions() Gets a description of the arguments expected from command line.
org.apache.hadoop.fs.Path[]	getHierarchyDataPaths() Gets the paths to hierarchy data catalogs.
org.apache.hadoop.fs.Path	getHierarchyIndexPath() Gets the HDFS path where the hierarchy data index is located or should be placed once it is generated
java.lang.Class<? extends HierarchyInfo>	getHierarchyInfoClass() Gets the HierarchyInfo implementing class which describes the current hierarchy
MVSConfig	getMvsConfig() Gets the MVSuggest configuration
SpatialOperationConfig	getSpatialOperationConfig() Gets the configuration of the spatial operation to be performed
static void	main(java.lang.String[] args)
void	processArgs(java.lang.String[] args, org.apache.hadoop.conf.Configuration conf) Extracts and validates arguments from the command line
int	run(java.lang.String[] args)
void	setHierarchyDataPaths(org.apache.hadoop.fs.Path[] hierarchyDataPaths) Sets the paths to hierarchy data catalogs.
void	setHierarchyIndexPath(org.apache.hadoop.fs.Path hieararchyDataIndexPath) Sets the HDFS path where the hierarchy data index is located or should be placed once it is generated
void	setHierarchyInfoClass(java.lang.Class<? extends HierarchyInfo> hierarchyInfoClass) Sets the HierarchyInfo implementing class which describes the current hierarchy
void	setMvsConfig(MVSConfig mvsConfig) Sets the MVSuggest configuration
void	setSpatialOperationConfig(SpatialOperationConfig spatialOperationConfig) Sets the configuration of the spatial operation to be performed.

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.IndexedInputBaseJob

configure, getIndexMetadataDir, getIndexName, isInputIndex, setIndexMetadataDir, setIndexName, setInputIndex

Methods inherited from class oracle.spatial.hadoop.vector.mapred.job.BaseJob

createJob, createJob, createJob, createJob, createJobConf, createJobConf, createJobConf, getInput, getInputFormatClass, getJarClass, getOutput, getRecordInfoProviderClass, getSpatialConfig, setInput, setInputFormatClass, setJarClass, setOutput, setRecordInfoProviderClass, setSpatialConfig

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

mvsService

protected MVSService mvsService

Constructor Detail

Categorization

public Categorization()

Method Detail

setHierarchyInfoClass

public void setHierarchyInfoClass(java.lang.Class<? extends HierarchyInfo> hierarchyInfoClass)

Sets the HierarchyInfo implementing class which describes the current hierarchy

Parameters:

hierarchyInfoClass - a subclass of HierarchyInfo

getHierarchyInfoClass

public java.lang.Class<? extends HierarchyInfo> getHierarchyInfoClass()

Gets the HierarchyInfo implementing class which describes the current hierarchy

Returns:

a subclass of HierarchyInfo

setSpatialOperationConfig

public void setSpatialOperationConfig(SpatialOperationConfig spatialOperationConfig)

Sets the configuration of the spatial operation to be performed. The query window is not needed.

Parameters:

spatialOperationConfig - a spatial operation configuration.

getSpatialOperationConfig

public SpatialOperationConfig getSpatialOperationConfig()

Gets the configuration of the spatial operation to be performed

Returns:

a spatial operation configuration

setHierarchyIndexPath

public void setHierarchyIndexPath(org.apache.hadoop.fs.Path hieararchyDataIndexPath)

Sets the HDFS path where the hierarchy data index is located or should be placed once it is generated

Parameters:

hieararchyDataIndexPath - an HDFS path

getHierarchyIndexPath

public org.apache.hadoop.fs.Path getHierarchyIndexPath()

Gets the HDFS path where the hierarchy data index is located or should be placed once it is generated

Returns:

an HDFS path

setHierarchyDataPaths

public void setHierarchyDataPaths(org.apache.hadoop.fs.Path[] hierarchyDataPaths)

Sets the paths to hierarchy data catalogs. The paths are expected to be sorted in ascending way according to the hierarchy level each path represents. For example: path[0] is the path to the catalog of the hierarchy level 1, path[1] is the path for hierarchy level 2 and so on.

Parameters:

hierarchyDataPaths - an array of paths

getHierarchyDataPaths

public org.apache.hadoop.fs.Path[] getHierarchyDataPaths()

Gets the paths to hierarchy data catalogs. The paths are expected to be sorted in ascending way according to the hierarchy level each path represents. For example: path[0] is the path to the catalog of the hierarchy level 1, path[1] is the path for hierarchy level 2 and so on.

Returns:

an array of paths

setMvsConfig

public void setMvsConfig(MVSConfig mvsConfig)

Sets the MVSuggest configuration

Parameters:

mvsConfig - the MVSuggest configuration

getMvsConfig

public MVSConfig getMvsConfig()

Gets the MVSuggest configuration

Returns:

the MVSuggest configuration

processArgs

public void processArgs(java.lang.String[] args,
                        org.apache.hadoop.conf.Configuration conf)

Description copied from class: BaseJob

Extracts and validates arguments from the command line

Overrides:

processArgs in class IndexedInputBaseJob<K,V>

Parameters:

args - arguments from the command line

conf - the job configuration

getCmdOptions

public java.lang.String getCmdOptions()

Description copied from class: BaseJob

Gets a description of the arguments expected from command line.

Overrides:

getCmdOptions in class IndexedInputBaseJob<K,V>

Returns:

a text description

configure

public void configure(org.apache.hadoop.mapred.JobConf conf)
               throws java.lang.Exception

Description copied from class: BaseJob

Validates and adds the current parameters to the job configuration

Overrides:

configure in class IndexedInputBaseJob<K,V>

Parameters:

conf - the job configuration

Throws:

java.lang.Exception

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception