oracle.spatial.hadoop.vector.geojson.mapreduce

Class GeoJsonInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

oracle.spatial.hadoop.vector.geojson.mapreduce.GeoJsonInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class GeoJsonInputFormat
extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>
implements org.apache.hadoop.conf.Configurable

FileInputFormat for GeoJSON text files. Multi-line JSON is supported. By default the input format will search for feature objects , this can be changed by providing a different parsing type. Keys are the position in the file, and values are the GeoJSON text. The GeoJSON text is not validated during the parsing.

Constructor Summary

Constructors

Constructor and Description
GeoJsonInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
org.apache.hadoop.conf.Configuration	getConf()
static GeoJsonParseType	getGeoJsonTypesToParse(org.apache.hadoop.conf.Configuration conf) Returns the GeoJSON parsing type
protected boolean	isSplitable(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path fileName)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setGeoJsonTypesToParse(org.apache.hadoop.conf.Configuration conf, GeoJsonParseType parseType) Sets GeoJSON parsing type.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GeoJsonInputFormat

public GeoJsonInputFormat()

Method Detail

setGeoJsonTypesToParse

public static void setGeoJsonTypesToParse(org.apache.hadoop.conf.Configuration conf,
                                          GeoJsonParseType parseType)

Sets GeoJSON parsing type.

Parameters:

conf - the job configuration

parseType - the GeoJSON parsing type

getGeoJsonTypesToParse

public static GeoJsonParseType getGeoJsonTypesToParse(org.apache.hadoop.conf.Configuration conf)

Returns the GeoJSON parsing type

Parameters:

conf - the job configuration

Returns:

the GeoJSON parsing type

isSplitable

protected boolean isSplitable(org.apache.hadoop.mapreduce.JobContext context,
                              org.apache.hadoop.fs.Path fileName)

Overrides:

isSplitable in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                                         throws java.io.IOException,
                                                                                                                                java.lang.InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable