oracle.kv.hadoop.hive.table

Class TableStorageHandler

java.lang.Object

org.apache.hadoop.hive.ql.metadata.DefaultStorageHandler

oracle.kv.hadoop.hive.table.TableStorageHandler

All Implemented Interfaces:

Configurable, HiveStorageHandler

public class TableStorageHandler
extends DefaultStorageHandler

Concrete implementation of TableStorageHandlerBase; which assumes that the data accessed from the desired Oracle NoSQL Database has been stored, and will be accessed, via the Table API.

Since:

3.1

Field Summary

Fields

Modifier and Type	Field and Description
protected int	batchSize
protected Consistency	consistency
protected Direction	direction
protected String	fieldRangeProperty
protected JobConf	jobConf
protected String[]	kvHadoopHosts
protected String[]	kvHelperHosts
protected String	kvStoreName
protected String	kvStoreSecurityFile
protected int	maxBatches
protected int	maxRequests
protected String	primaryKeyProperty
protected String	tableName
protected long	timeout
protected TimeUnit	timeoutUnit

Constructor Summary

Constructors

Constructor and Description
TableStorageHandler()

Method Summary

Methods

Modifier and Type	Method and Description
void	configureInputJobProperties(TableDesc tableDesc, Map<String,String> jobProperties) Creates a configuration for job input.
void	configureOutputJobProperties(TableDesc tableDesc, Map<String,String> jobProperties) Using semantics identical to the semantics of the configureInputJobProperties method, creates a configuration for job output.
void	configureTableJobProperties(TableDesc tableDesc, Map<String,String> jobProperties) Although this method was originally intended to configure properties for a job based on the definition of the source or target table the job accesses, this method is now deprecated in Hive.
Class<? extends InputFormat>	getInputFormatClass()
Class<? extends OutputFormat>	getOutputFormatClass()
Class<? extends SerDe>	getSerDeClass()

Methods inherited from class org.apache.hadoop.hive.ql.metadata.DefaultStorageHandler

configureJobConf, getAuthorizationProvider, getConf, getMetaHook, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

kvStoreName

protected String kvStoreName

kvHelperHosts

protected String[] kvHelperHosts

kvHadoopHosts

protected String[] kvHadoopHosts

tableName

protected String tableName

primaryKeyProperty

protected String primaryKeyProperty

fieldRangeProperty

protected String fieldRangeProperty

direction

protected Direction direction

consistency

protected Consistency consistency

timeout

protected long timeout

timeoutUnit

protected TimeUnit timeoutUnit

maxRequests

protected int maxRequests

batchSize

protected int batchSize

maxBatches

protected int maxBatches

kvStoreSecurityFile

protected String kvStoreSecurityFile

jobConf

protected JobConf jobConf

Constructor Detail

TableStorageHandler

public TableStorageHandler()

Method Detail

getInputFormatClass

public Class<? extends InputFormat> getInputFormatClass()

Specified by:

getInputFormatClass in interface HiveStorageHandler

Overrides:

getInputFormatClass in class DefaultStorageHandler

getOutputFormatClass

public Class<? extends OutputFormat> getOutputFormatClass()

Specified by:

getOutputFormatClass in interface HiveStorageHandler

Overrides:

getOutputFormatClass in class DefaultStorageHandler

getSerDeClass

public Class<? extends SerDe> getSerDeClass()

Specified by:

getSerDeClass in interface HiveStorageHandler

Overrides:

getSerDeClass in class DefaultStorageHandler

configureInputJobProperties

public void configureInputJobProperties(TableDesc tableDesc,
                               Map<String,String> jobProperties)

Creates a configuration for job input. This method provides the mechanism for populating this StorageHandler's configuration (returned by JobContext.getConfiguration) with the properties that may be needed by the handler's bundled artifacts; for example, the InputFormat class, the SerDe class, etc. returned by this handler. Any key value pairs set in the jobProperties argument are guaranteed to be set in the job's configuration object; and any "context" information associated with the job can be retrieved from the given TableDesc parameter.

Note that implementations of this method must be idempotent. That is, when this method is invoked more than once with the same tableDesc values for a given job, the key value pairs in jobProperties, as well as any external state set by this method, should be the same after each invocation. How this invariant guarantee is achieved is left as an implementation detail; although to support this guarantee, changes should only be made to the contents of jobProperties, but never to tableDesc.

Specified by:

configureInputJobProperties in interface HiveStorageHandler

Overrides:

configureInputJobProperties in class DefaultStorageHandler

configureOutputJobProperties

public void configureOutputJobProperties(TableDesc tableDesc,
                                Map<String,String> jobProperties)

Using semantics identical to the semantics of the configureInputJobProperties method, creates a configuration for job output. For more detail, refer to the description of the configureInputJobProperties method.

Specified by:

configureOutputJobProperties in interface HiveStorageHandler

Overrides:

configureOutputJobProperties in class DefaultStorageHandler

configureTableJobProperties

public void configureTableJobProperties(TableDesc tableDesc,
                               Map<String,String> jobProperties)

Although this method was originally intended to configure properties for a job based on the definition of the source or target table the job accesses, this method is now deprecated in Hive. The methods configureInputJobProperties and configureOutputJobProperties should be used instead.

Specified by:

configureTableJobProperties in interface HiveStorageHandler

Overrides:

configureTableJobProperties in class DefaultStorageHandler