oracle.spatial.hadoop.vector.geojson.mapred

Class GeoJsonInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

oracle.spatial.hadoop.vector.geojson.mapred.GeoJsonInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

public class GeoJsonInputFormat
extends org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>
implements org.apache.hadoop.conf.Configurable

FileInputFormat for GeoJSON text files. Multi-line JSON is supported. By default the input format will search for feature objects , this can be changed by providing a different parsing type. Keys are the position in the file, and values are the GeoJSON text. The GeoJSON text is not validated during the parsing.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
GeoJsonInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
static GeoJsonParseType	getGeoJsonTypesToParse(org.apache.hadoop.mapred.JobConf conf) Returns the GeoJSON parsing type
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.mapred.Reporter reporter)
protected boolean	isSplitable(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path fileName)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setGeoJsonTypesToParse(org.apache.hadoop.mapred.JobConf conf, GeoJsonParseType parseType) Sets GeoJSON parsing type.

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GeoJsonInputFormat

public GeoJsonInputFormat()

Method Detail

setGeoJsonTypesToParse

public static void setGeoJsonTypesToParse(org.apache.hadoop.mapred.JobConf conf,
                                          GeoJsonParseType parseType)

Sets GeoJSON parsing type.

Parameters:

conf - the job configuration

parseType - the GeoJSON parsing type

getGeoJsonTypesToParse

public static GeoJsonParseType getGeoJsonTypesToParse(org.apache.hadoop.mapred.JobConf conf)

Returns the GeoJSON parsing type

Parameters:

conf - the job configuration

Returns:

the GeoJSON parsing type

isSplitable

protected boolean isSplitable(org.apache.hadoop.fs.FileSystem fs,
                              org.apache.hadoop.fs.Path fileName)

Overrides:

isSplitable in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

getRecordReader

public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                                                                          org.apache.hadoop.mapred.JobConf conf,
                                                                                                                          org.apache.hadoop.mapred.Reporter reporter)
                                                                                                                   throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable