oracle.spatial.hadoop.vector.nosql.mapreduce

Class NoSQLInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,RecordInfo>

oracle.spatial.hadoop.vector.nosql.mapreduce.NoSQLInputFormat

Direct Known Subclasses:

NoSQLInputFormat

public class NoSQLInputFormat
extends org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,RecordInfo>

An InputFormat class that can read information from a NoSQL KV store. Multiple NoSQL entries can be grouped into a single Hadoop mapper record defined as a key-value pair of types Text and RecordInfo respectively

Constructor Summary

Constructors

Constructor and Description
NoSQLInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,RecordInfo>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
protected NoSQLConfiguration	getKVConfiguration(org.apache.hadoop.conf.Configuration conf)
protected java.util.List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.conf.Configuration conf)
java.util.List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NoSQLInputFormat

public NoSQLInputFormat()

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,RecordInfo> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                         org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                  throws java.io.IOException,
                                                                                                         java.lang.InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,RecordInfo>

Throws:

java.io.IOException

java.lang.InterruptedException

getSplits

public java.util.List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context)
                                                                 throws java.io.IOException,
                                                                        java.lang.InterruptedException

Specified by:

getSplits in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,RecordInfo>

Throws:

java.io.IOException

java.lang.InterruptedException

getSplits

protected java.util.List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.conf.Configuration conf)

getKVConfiguration

protected NoSQLConfiguration getKVConfiguration(org.apache.hadoop.conf.Configuration conf)