odcp Reference
The odcp command-line utility has the single command odcp
, with parameters and options as described below.
Syntax
odcp [options] source1 [source2 ...] destination
Parameters
Parameter | Description |
---|---|
source1 [source2 ...]
|
The source can be any of the following:
If you specify multiple sources, list them one after the other:
If two or more source files have the same name, nothing is copied and Regular expressions are supported through these parameters:
|
destination |
The destination can be any of the following:
|
Use the following formats:
-
For HDFS:
hdfs:///path/[file]
For example:
hdfs:///user/company/data.raw
or
hdfs://[host:port]/path/[file]
For example:
hdfs://192.0.2.0:22/user/company/data.raw
-
For Oracle Storage Cloud Service::
swift://container.provider/[file]
where
-
container
is the name of a container in the Oracle Storage Cloud Service instance. -
provider
is the provider name that serves as an alias for the credentials for accessing the instance. See Register Storage Credentials with the Cluster.
For example:
swift://feeds.BDCS/stream–061016–1827–534
-
For examples showing other storage types, see odcp Supported Storage Sources and Targets
Options
Option | Description |
---|---|
|
Destination file part size in bytes.
The remainder after dividing |
|
Concatenate the file chunks (default). |
|
Specify the number of executor cores. The default value is |
|
Specify the executors memory limit in gigabytes. The default value is |
|
Specify extra configuration options. For example: --extra-conf spark.kryoserializer.buffer.max=128m |
|
Specify files to concatenate to a |
|
Show help for this command. |
|
The full path to the keytab file of the Kerberos principal. (Use in a Kerberos-enabled Spark environment only.) |
|
The Kerberos principal. (Use in a Kerberos-enabled Spark environment only.) |
|
Don’t overwrite an existing file. |
|
Don’t copy files recursively. |
|
Specify the number of executors. The default value is |
|
Show the progress of the data transfer. |
|
Retry if the previous transfer failed or was interrupted. |
|
Destination file part size in bytes.
The remainder after dividing |
|
The path to a directory containing an Apache Spark installation. If nothing is specified, |
|
Filters sources by matching the source name with a regular expression.
|
--sync |
Synchronize the |
|
Enable verbose mode for debugging. |