oracle.spatial.hadoop.vector.shapefile.mapred

Class ShapeFileInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

oracle.spatial.hadoop.vector.shapefile.mapred.ShapeFileInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

public class ShapeFileInputFormat
extends org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>
implements org.apache.hadoop.conf.Configurable

FileInputFormat for ESRI Shapefiles. The input has to be the main file (.shp). The directories in HDFS where the index files and DBF files are located can be specified. As well a directory to find .cpg files can be specified to define the encoding. By default the same directory as the main shapefile will be used. DBF and CPG files are optional. Keys are the position in the main file, and values are Maps with the attributes of the Shapefile record including the ShapeFileInputFormat.GEOMETRY_ATTRIBUTE.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	GEOMETRY_ATTRIBUTE The name of the geometry attribute.

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

Constructors

Constructor and Description
ShapeFileInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
static java.lang.String	getCPGFilesPath(org.apache.hadoop.mapred.JobConf conf) Returns the optional CPG files path.
static java.lang.String	getDBFFilesPath(org.apache.hadoop.mapred.JobConf conf) Returns the optional DBF files path.
static java.lang.String	getIndexFilesPath(org.apache.hadoop.mapred.JobConf conf) Returns the index files path.
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter)
protected boolean	isSplitable(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path fileName)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setCPGFilesPath(org.apache.hadoop.mapred.JobConf conf, java.lang.String cpgFilePath) Sets the CPG files path.
static void	setDBFFilesPath(org.apache.hadoop.mapred.JobConf conf, java.lang.String dbfFilePath) Sets the DBF files path.
static void	setIndexFilesPath(org.apache.hadoop.mapred.JobConf conf, java.lang.String indexFilePath) Sets the index files path.

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

GEOMETRY_ATTRIBUTE

public static java.lang.String GEOMETRY_ATTRIBUTE

The name of the geometry attribute.

Constructor Detail

ShapeFileInputFormat

public ShapeFileInputFormat()

Method Detail

getIndexFilesPath

public static java.lang.String getIndexFilesPath(org.apache.hadoop.mapred.JobConf conf)

Returns the index files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

Returns:

the index files path

setIndexFilesPath

public static void setIndexFilesPath(org.apache.hadoop.mapred.JobConf conf,
                                     java.lang.String indexFilePath)

Sets the index files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

indexFilePath - the index files path

getDBFFilesPath

public static java.lang.String getDBFFilesPath(org.apache.hadoop.mapred.JobConf conf)

Returns the optional DBF files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

Returns:

the DBF files path

setDBFFilesPath

public static void setDBFFilesPath(org.apache.hadoop.mapred.JobConf conf,
                                   java.lang.String dbfFilePath)

Sets the DBF files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

dbfFilePath - the DBF files path

getCPGFilesPath

public static java.lang.String getCPGFilesPath(org.apache.hadoop.mapred.JobConf conf)

Returns the optional CPG files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

Returns:

the CPG files path

setCPGFilesPath

public static void setCPGFilesPath(org.apache.hadoop.mapred.JobConf conf,
                                   java.lang.String cpgFilePath)

Sets the CPG files path. By default the same path as the main file will be used.

Parameters:

conf - the job configuration

cpgFilePath - the CPG files path

isSplitable

protected boolean isSplitable(org.apache.hadoop.fs.FileSystem fs,
                              org.apache.hadoop.fs.Path fileName)

Overrides:

isSplitable in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

getRecordReader

public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                                                                                 org.apache.hadoop.mapred.JobConf conf,
                                                                                                                                 org.apache.hadoop.mapred.Reporter reporter)
                                                                                                                          throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.MapWritable>

Throws:

java.io.IOException

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable