oracle.spatial.hadoop.vector.shapefile.mapreduce

Class ShapeFileInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

oracle.spatial.hadoop.vector.shapefile.mapreduce.ShapeFileInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class ShapeFileInputFormat
extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>
implements org.apache.hadoop.conf.Configurable

FileInputFormat for ESRI Shapefiles. The input has to be the main file (.shp). The directories in HDFS where the index files and DBF files are located can be specified. As well a directory to find .cpg files can be specified to define the encoding. By default the same directory as the main shapefile will be used. DBF and CPG files are optional. Keys are the position in the main file, and values are Maps with the attributes of the Shapefile record including the ShapeFileInputFormat.GEOMETRY_ATTRIBUTE.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	GEOMETRY_ATTRIBUTE The name of the geometry attribute.

Constructor Summary

Constructors

Constructor and Description
ShapeFileInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
org.apache.hadoop.conf.Configuration	getConf()
static java.lang.String	getCPGFilesPath(org.apache.hadoop.conf.Configuration conf) Returns the optional CPG files path.
static java.lang.String	getDBFFilesPath(org.apache.hadoop.conf.Configuration conf) Returns the optional DBF files path.
static java.lang.String	getIndexFilesPath(org.apache.hadoop.conf.Configuration conf) Returns the index files path.
protected boolean	isSplitable(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path fileName)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setCPGFilesPath(org.apache.hadoop.conf.Configuration conf, java.lang.String cpgFilePath) Sets the CPG files path.
static void	setDBFFilesPath(org.apache.hadoop.conf.Configuration conf, java.lang.String dbfFilePath) Sets the DBF files path.
static void	setIndexFilesPath(org.apache.hadoop.conf.Configuration conf, java.lang.String indexFilePath) Sets the index files path.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

GEOMETRY_ATTRIBUTE

public static java.lang.String GEOMETRY_ATTRIBUTE

The name of the geometry attribute.

Constructor Detail

ShapeFileInputFormat

public ShapeFileInputFormat()

Method Detail

getIndexFilesPath

public static java.lang.String getIndexFilesPath(org.apache.hadoop.conf.Configuration conf)

Returns the index files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

Returns:

the index files path

setIndexFilesPath

public static void setIndexFilesPath(org.apache.hadoop.conf.Configuration conf,
                                     java.lang.String indexFilePath)

Sets the index files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

indexFilePath - the index files path

getDBFFilesPath

public static java.lang.String getDBFFilesPath(org.apache.hadoop.conf.Configuration conf)

Returns the optional DBF files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

Returns:

the DBF files path

setDBFFilesPath

public static void setDBFFilesPath(org.apache.hadoop.conf.Configuration conf,
                                   java.lang.String dbfFilePath)

Sets the DBF files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

dbfFilePath - the DBF files path

getCPGFilesPath

public static java.lang.String getCPGFilesPath(org.apache.hadoop.conf.Configuration conf)

Returns the optional CPG files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

Returns:

the CPG files path

setCPGFilesPath

public static void setCPGFilesPath(org.apache.hadoop.conf.Configuration conf,
                                   java.lang.String cpgFilePath)

Sets the CPG files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

cpgFilePath - the CPG files path

isSplitable

protected boolean isSplitable(org.apache.hadoop.mapreduce.JobContext context,
                              org.apache.hadoop.fs.Path fileName)

Overrides:

isSplitable in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                                                throws java.io.IOException,
                                                                                                                                       java.lang.InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

Throws:

java.io.IOException

java.lang.InterruptedException

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable