oracle.spatial.hadoop.vector.data

Class InputDataSetUtils

java.lang.Object

oracle.spatial.hadoop.vector.data.InputDataSetUtils

public class InputDataSetUtils
extends java.lang.Object

Contains utility static methods related to data sets.

Constructor Summary

Constructors

Constructor and Description
InputDataSetUtils()

Method Summary

Methods

Modifier and Type	Method and Description
static InputDataSet	createInputDataSet(java.lang.String[] args)
static AbstractInputDataSet	getBestFittingInputDataSetType(FileInputDataSet dataSet) Converts the given input data set to the most general class possible.
static AbstractInputDataSet	getBestFittingInputDataSetType(SpatialIndexInputDataSet dataSet) Converts the given input data set to the most general class possible.
static java.lang.String[]	getInputDataSetLocations(AbstractInputDataSet dataSet) Gets the location(s) of the given input data set when the location is available.
static org.apache.hadoop.mapreduce.InputSplit	getInputSplitForInputFormat(java.lang.Class<org.apache.hadoop.mapreduce.InputFormat<?,?>> infClass, org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.conf.Configuration conf) Returns the type of InputSplit expected by the given InputFormat class
static boolean	isFileInputFormat(java.lang.Class<?> inputFormatClass) Utility method used to know if a given class is a subclass of FileInputFormat from wither, Hadoop old or new API
static <K,V> AbstractInputDataSet	loadInputDataSet(org.apache.hadoop.conf.Configuration conf) Loads an instance of AbstractInputDataSet stored in the configuration
static <K,V> AbstractInputDataSet	loadInputDataSet(java.lang.String tag, org.apache.hadoop.conf.Configuration conf) Loads an instance of AbstractInputDataSet stored in the configuration using the the given tag
static void	validateInputDataSet(InputDataSet inputDs, org.apache.hadoop.mapreduce.Job job)
static void	validateInputDataSet(InputDataSet inputDs, org.apache.hadoop.mapred.JobConf jobConf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InputDataSetUtils

public InputDataSetUtils()

Method Detail

isFileInputFormat

public static boolean isFileInputFormat(java.lang.Class<?> inputFormatClass)

Utility method used to know if a given class is a subclass of FileInputFormat from wither, Hadoop old or new API

Parameters:

inputFormatClass - true if the given class is a subclass of FileInputFormat

Returns:

getInputDataSetLocations

public static java.lang.String[] getInputDataSetLocations(AbstractInputDataSet dataSet)

Gets the location(s) of the given input data set when the location is available. For MultiInputDataSet, the locations of all the contained input data sets are returned.

Parameters:

dataSet - an input data set

Returns:

an array of locations

getBestFittingInputDataSetType

public static AbstractInputDataSet getBestFittingInputDataSetType(SpatialIndexInputDataSet dataSet)

Converts the given input data set to the most general class possible. That is, if the input data set only contains information from a file input data set instead of an index name, it will be returned and instance of FileInputFormat. If the given input data set does not contain a path or an index name, a SimpleInputDataSet will be returned

Parameters:

dataSet - a SpatialIndexInputDataSet which may not be a real spatial index

Returns:

an instance of AbstractInputDataSet

getBestFittingInputDataSetType

public static AbstractInputDataSet getBestFittingInputDataSetType(FileInputDataSet dataSet)

Converts the given input data set to the most general class possible. If the given input data set is not associated to a file, a SimpleInputDataSet will be returned

Parameters:

dataSet - a FileInputDataSet which may not be associated to a file.

Returns:

an instance of AbstractInputDataSet

loadInputDataSet

public static <K,V> AbstractInputDataSet loadInputDataSet(org.apache.hadoop.conf.Configuration conf)
                                             throws java.lang.IllegalAccessException,
                                                    java.lang.InstantiationException

Loads an instance of AbstractInputDataSet stored in the configuration

Parameters:

conf - a job's configuration

Returns:

an instance of AbstractInputDataSet or null if no information was found

Throws:

java.lang.IllegalAccessException

java.lang.InstantiationException

loadInputDataSet

public static <K,V> AbstractInputDataSet loadInputDataSet(java.lang.String tag,
                                          org.apache.hadoop.conf.Configuration conf)

Loads an instance of AbstractInputDataSet stored in the configuration using the the given tag

Parameters:

tag - a prefix appended to the input data set if any

conf - a job's configuration

Returns:

an instance of AbstractInputDataSet or null if no information was found

getInputSplitForInputFormat

public static org.apache.hadoop.mapreduce.InputSplit getInputSplitForInputFormat(java.lang.Class<org.apache.hadoop.mapreduce.InputFormat<?,?>> infClass,
                                                                 org.apache.hadoop.mapreduce.InputSplit split,
                                                                 org.apache.hadoop.conf.Configuration conf)
                                                                          throws java.io.IOException

Returns the type of InputSplit expected by the given InputFormat class

Parameters:

infClass - an InputFormat

split - an InputSplit

conf - a job's configuration

Returns:

an InputSplit adapted to the type expected to the given InputFormat when applicable

Throws:

java.io.IOException

createInputDataSet

public static InputDataSet createInputDataSet(java.lang.String[] args)

validateInputDataSet

public static void validateInputDataSet(InputDataSet inputDs,
                        org.apache.hadoop.mapred.JobConf jobConf)
                                 throws java.lang.Exception

Throws:

java.lang.Exception

validateInputDataSet

public static void validateInputDataSet(InputDataSet inputDs,
                        org.apache.hadoop.mapreduce.Job job)
                                 throws java.lang.Exception

Throws:

java.lang.Exception