oracle.spatial.hadoop.vector

Class DistributedDataSet

java.lang.Object

oracle.spatial.hadoop.vector.data.SimpleInputDataSet

oracle.spatial.hadoop.vector.data.FileInputDataSet

oracle.spatial.hadoop.vector.data.SpatialIndexInputDataSet

oracle.spatial.hadoop.vector.InputDataSet

oracle.spatial.hadoop.vector.DistributedDataSet

All Implemented Interfaces:

ConfigurationStorable, AbstractInputDataSet, IODataSet

public class DistributedDataSet
extends InputDataSet

A validated, normalized and ready to be distributed version of InputDataSet. An instance of this type is expected to have all the information needed to read and parse the data set it represents.
A distributed data set has a unique id so it can be identified along a job life cycle.

Author:

hsaucedo

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CONF_DS_INPUT_FORMAT_PREFIX
static java.lang.String	CONF_DS_KEYS_PREFIX
static java.lang.String	CONF_DS_LEN_PREFIX
static java.lang.String	CONF_DS_PATHS_PREFIX
static java.lang.String	CONF_DS_RI_PROVIDER_PREFIX
static java.lang.String	CONF_DS_SPATIAL_CONF_PREFIX

Constructor Summary

Constructors

Constructor and Description
DistributedDataSet() Creates a new instance
DistributedDataSet(int id) Creates a new instance with an id

Method Summary

Modifier and Type	Method and Description
int	getId() Gets the data set id
java.util.Set<java.lang.String>	getKeys() Gets the keys that identify every path of the data set
long	getLength() Gets the data set length in bytes
void	load(Configuration conf) Loads data set information from the configuration.
void	load(int id, Configuration conf) Loads information of the data set with the given id from the configuration
void	setId(int id) Sets the data set id
void	setInputDataSet(InputDataSet ids) Copies the information from the input data set
void	setKeys(java.util.Set<java.lang.String> keys) Sets the keys that identify every path of the data set
void	setLength(long length) Sets the data set length in bytes
void	store(Configuration conf) Stores the current data set information in the configuration

Methods inherited from class oracle.spatial.hadoop.vector.data.SpatialIndexInputDataSet

getIndexMetadataDir, getIndexName, isInputIndex, setIndexMetadataDir, setIndexName, setInputIndex

Methods inherited from class oracle.spatial.hadoop.vector.data.FileInputDataSet

getInputString, getPaths, setInputString, setPaths

Methods inherited from class oracle.spatial.hadoop.vector.data.SimpleInputDataSet

getInputFormatClass, getRecordInfoProviderClass, getSpatialConfig, setInputFormatClass, setRecordInfoProviderClass, setSpatialConfig

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONF_DS_INPUT_FORMAT_PREFIX

public static final java.lang.String CONF_DS_INPUT_FORMAT_PREFIX

See Also:

Constant Field Values

CONF_DS_KEYS_PREFIX

public static final java.lang.String CONF_DS_KEYS_PREFIX

See Also:

Constant Field Values

CONF_DS_LEN_PREFIX

public static final java.lang.String CONF_DS_LEN_PREFIX

See Also:

Constant Field Values

CONF_DS_PATHS_PREFIX

public static final java.lang.String CONF_DS_PATHS_PREFIX

See Also:

Constant Field Values

CONF_DS_RI_PROVIDER_PREFIX

public static final java.lang.String CONF_DS_RI_PROVIDER_PREFIX

See Also:

Constant Field Values

CONF_DS_SPATIAL_CONF_PREFIX

public static final java.lang.String CONF_DS_SPATIAL_CONF_PREFIX

See Also:

Constant Field Values

Constructor Detail

DistributedDataSet

public DistributedDataSet()

Creates a new instance

DistributedDataSet

public DistributedDataSet(int id)

Creates a new instance with an id

Parameters:

id -

Method Detail

getId

public int getId()

Gets the data set id

Returns:

getKeys

public java.util.Set<java.lang.String> getKeys()

Gets the keys that identify every path of the data set

Returns:

getLength

public long getLength()

Gets the data set length in bytes

Specified by:

getLength in interface AbstractInputDataSet

Overrides:

getLength in class SimpleInputDataSet

Returns:

load

public void load(Configuration conf)

Loads data set information from the configuration. An id had to be set previously or the data set with id 0 will be looked for.

Specified by:

load in interface ConfigurationStorable

Overrides:

load in class FileInputDataSet

Parameters:

conf -

load

public void load(int id,
                 Configuration conf)

Loads information of the data set with the given id from the configuration

Parameters:

id -

conf -

setId

public void setId(int id)

Sets the data set id

Parameters:

id -

setInputDataSet

public void setInputDataSet(InputDataSet ids)

Copies the information from the input data set

Parameters:

ids -

setKeys

public void setKeys(java.util.Set<java.lang.String> keys)

Sets the keys that identify every path of the data set

Parameters:

keys -

setLength

public void setLength(long length)

Sets the data set length in bytes

Specified by:

setLength in interface AbstractInputDataSet

Overrides:

setLength in class SimpleInputDataSet

Parameters:

length -

store

public void store(Configuration conf)

Stores the current data set information in the configuration

Specified by:

store in interface ConfigurationStorable

Overrides:

store in class FileInputDataSet

Parameters:

conf -