public class TableStorageHandler extends DefaultStorageHandler
Modifier and Type | Field and Description |
---|---|
protected int |
batchSize |
protected Consistency |
consistency |
protected Direction |
direction |
protected String |
fieldRangeProperty |
protected JobConf |
jobConf |
protected String[] |
kvHadoopHosts |
protected String[] |
kvHelperHosts |
protected String |
kvStoreName |
protected String |
kvStoreSecurityFile |
protected int |
maxBatches |
protected int |
maxRequests |
protected String |
primaryKeyProperty |
protected String |
tableName |
protected long |
timeout |
protected TimeUnit |
timeoutUnit |
Constructor and Description |
---|
TableStorageHandler() |
Modifier and Type | Method and Description |
---|---|
void |
configureInputJobProperties(TableDesc tableDesc,
Map<String,String> jobProperties)
Creates a configuration for job input.
|
void |
configureOutputJobProperties(TableDesc tableDesc,
Map<String,String> jobProperties)
Using semantics identical to the semantics of the
configureInputJobProperties method, creates a
configuration for job output. |
void |
configureTableJobProperties(TableDesc tableDesc,
Map<String,String> jobProperties)
Although this method was originally intended to configure
properties for a job based on the definition of the source or
target table the job accesses, this method is now deprecated
in Hive.
|
Class<? extends InputFormat> |
getInputFormatClass() |
Class<? extends OutputFormat> |
getOutputFormatClass() |
Class<? extends SerDe> |
getSerDeClass() |
configureJobConf, getAuthorizationProvider, getConf, getMetaHook, setConf
protected String kvStoreName
protected String[] kvHelperHosts
protected String[] kvHadoopHosts
protected String tableName
protected String primaryKeyProperty
protected String fieldRangeProperty
protected Direction direction
protected Consistency consistency
protected long timeout
protected TimeUnit timeoutUnit
protected int maxRequests
protected int batchSize
protected int maxBatches
protected String kvStoreSecurityFile
protected JobConf jobConf
public Class<? extends InputFormat> getInputFormatClass()
getInputFormatClass
in interface HiveStorageHandler
getInputFormatClass
in class DefaultStorageHandler
public Class<? extends OutputFormat> getOutputFormatClass()
getOutputFormatClass
in interface HiveStorageHandler
getOutputFormatClass
in class DefaultStorageHandler
public Class<? extends SerDe> getSerDeClass()
getSerDeClass
in interface HiveStorageHandler
getSerDeClass
in class DefaultStorageHandler
public void configureInputJobProperties(TableDesc tableDesc, Map<String,String> jobProperties)
JobContext.getConfiguration
) with the properties that
may be needed by the handler's bundled artifacts; for example, the
InputFormat
class, the SerDe
class, etc.
returned by this handler. Any key value pairs set in the
jobProperties
argument are guaranteed to be set in the
job's configuration object; and any "context" information associated
with the job can be retrieved from the given TableDesc
parameter.
Note that implementations of this method must be idempotent. That
is, when this method is invoked more than once with the same
tableDesc
values for a given job, the key value pairs
in jobProperties
, as well as any external state set
by this method, should be the same after each invocation. How this
invariant guarantee is achieved is left as an implementation detail;
although to support this guarantee, changes should only be made
to the contents of jobProperties
, but never to
tableDesc
.
configureInputJobProperties
in interface HiveStorageHandler
configureInputJobProperties
in class DefaultStorageHandler
public void configureOutputJobProperties(TableDesc tableDesc, Map<String,String> jobProperties)
configureInputJobProperties
method, creates a
configuration for job output. For more detail, refer to the
description of the configureInputJobProperties
method.configureOutputJobProperties
in interface HiveStorageHandler
configureOutputJobProperties
in class DefaultStorageHandler
public void configureTableJobProperties(TableDesc tableDesc, Map<String,String> jobProperties)
configureInputJobProperties
and configureOutputJobProperties
should be used
instead.configureTableJobProperties
in interface HiveStorageHandler
configureTableJobProperties
in class DefaultStorageHandler
Copyright (c) 2011, 2015 Oracle and/or its affiliates. All rights reserved.