K
- the type of the input keysV
- the type of the input valuespublic class Categorization<K,V> extends IndexedInputBaseJob<K,V>
The result will be a summary file for each hierarchical level containing the number of records from the non-hierarchical dataset per hierarchy level feature.
The categorization can be performed determining a spatial interaction specified by a spatial operation or using MVSuggest.
Constructor and Description |
---|
Categorization() |
Modifier and Type | Method and Description |
---|---|
void |
configure(JobConf jobConf)
Validates and adds the current parameters to the job configuration
|
java.lang.String |
getCmdOptions()
Gets a description of the arguments expected from command line.
|
java.util.Map<java.lang.String,java.lang.Object> |
getCurrentCmdArgs(Configuration conf)
Returns the current driver properties in a map where each key-value is a name and value of a command line argument.
|
Path[] |
getHierarchyDataPaths()
Gets the paths to hierarchy data catalogs.
|
Path |
getHierarchyIndexPath()
Gets the HDFS path where the hierarchy data index is located or should be placed once it is generated
|
java.lang.Class<? extends HierarchyInfo> |
getHierarchyInfoClass()
Gets the
HierarchyInfo implementing class which describes the current hierarchy |
MVSConfig |
getMvsConfig()
Gets the MVSuggest configuration
|
SpatialOperationConfig |
getSpatialOperationConfig()
Gets the configuration of the spatial operation to be performed
|
static <K,V> void |
main(java.lang.String[] args) |
void |
processArgs(java.lang.String[] args, Configuration conf)
Extracts and validates arguments from the command line
|
int |
run(java.lang.String[] args) |
void |
setHierarchyDataPaths(Path[] hierarchyDataPaths)
Sets the paths to hierarchy data catalogs.
|
void |
setHierarchyIndexPath(Path hieararchyDataIndexPath)
Sets the HDFS path where the hierarchy data index is located or should be placed once it is generated
|
void |
setHierarchyInfoClass(java.lang.Class<? extends HierarchyInfo> hierarchyInfoClass)
Sets the
HierarchyInfo implementing class which describes the current hierarchy |
void |
setMvsConfig(MVSConfig mvsConfig)
Sets the MVSuggest configuration
|
void |
setSpatialOperationConfig(SpatialOperationConfig spatialOperationConfig)
Sets the configuration of the spatial operation to be performed.
|
getIndexMetadataDir, getIndexName, isInputIndex, setIndexMetadataDir, setIndexName, setInputIndex
getCmdOptionsWithInputDataSets, getCurrentCmdArgsAsString, getInput, getInputDataSet, getInputFormatClass, getJarClass, getOutput, getRecordInfoProviderClass, getSpatialConfig, setInput, setInputDataSet, setInputFormatClass, setJarClass, setOutput, setRecordInfoProviderClass, setSpatialConfig
public void configure(JobConf jobConf) throws java.lang.Exception
BaseJob
public java.lang.String getCmdOptions()
BaseJob
getCmdOptions
in class BaseJob<K,V>
public java.util.Map<java.lang.String,java.lang.Object> getCurrentCmdArgs(Configuration conf)
BaseJob
getCurrentCmdArgs
in class BaseJob<K,V>
conf
- a job configurationpublic Path[] getHierarchyDataPaths()
public Path getHierarchyIndexPath()
public java.lang.Class<? extends HierarchyInfo> getHierarchyInfoClass()
HierarchyInfo
implementing class which describes the current hierarchyHierarchyInfo
public MVSConfig getMvsConfig()
public SpatialOperationConfig getSpatialOperationConfig()
public static <K,V> void main(java.lang.String[] args) throws java.lang.Exception
java.lang.Exception
public void processArgs(java.lang.String[] args, Configuration conf) throws java.lang.Exception
BaseJob
processArgs
in class BaseJob<K,V>
args
- arguments from the command lineconf
- the job configurationjava.lang.Exception
public int run(java.lang.String[] args) throws java.lang.Exception
java.lang.Exception
public void setHierarchyDataPaths(Path[] hierarchyDataPaths)
hierarchyDataPaths
- an array of pathspublic void setHierarchyIndexPath(Path hieararchyDataIndexPath)
hieararchyDataIndexPath
- an HDFS pathpublic void setHierarchyInfoClass(java.lang.Class<? extends HierarchyInfo> hierarchyInfoClass)
HierarchyInfo
implementing class which describes the current hierarchyhierarchyInfoClass
- a subclass of HierarchyInfo
public void setMvsConfig(MVSConfig mvsConfig)
mvsConfig
- the MVSuggest configurationpublic void setSpatialOperationConfig(SpatialOperationConfig spatialOperationConfig)
spatialOperationConfig
- a spatial operation configuration.Copyright © 2017, 2019 Oracle and/or its affiliates. All Rights Reserved.