PipelineDataflowConfigurationDetails

class oci.data_science.models.PipelineDataflowConfigurationDetails(**kwargs)

Bases: object

The configuration details of a Dataflow step.

Methods:

__init__(**kwargs)

Initializes a new PipelineDataflowConfigurationDetails object with values from keyword arguments.

Attributes:

configuration	Gets the configuration of this PipelineDataflowConfigurationDetails.
driver_shape	Gets the driver_shape of this PipelineDataflowConfigurationDetails.
driver_shape_config_details	Gets the driver_shape_config_details of this PipelineDataflowConfigurationDetails.
executor_shape	Gets the executor_shape of this PipelineDataflowConfigurationDetails.
executor_shape_config_details	Gets the executor_shape_config_details of this PipelineDataflowConfigurationDetails.
logs_bucket_uri	Gets the logs_bucket_uri of this PipelineDataflowConfigurationDetails.
num_executors	Gets the num_executors of this PipelineDataflowConfigurationDetails.
warehouse_bucket_uri	Gets the warehouse_bucket_uri of this PipelineDataflowConfigurationDetails.

__init__(**kwargs)

Initializes a new PipelineDataflowConfigurationDetails object with values from keyword arguments. The following keyword arguments are supported (corresponding to the getters/setters of this class):

Parameters

• configuration (object) – The value to assign to the configuration property of this PipelineDataflowConfigurationDetails.

• driver_shape (str) – The value to assign to the driver_shape property of this PipelineDataflowConfigurationDetails.

• driver_shape_config_details (oci.data_science.models.PipelineShapeConfigDetails) – The value to assign to the driver_shape_config_details property of this PipelineDataflowConfigurationDetails.

• executor_shape (str) – The value to assign to the executor_shape property of this PipelineDataflowConfigurationDetails.

• executor_shape_config_details (oci.data_science.models.PipelineShapeConfigDetails) – The value to assign to the executor_shape_config_details property of this PipelineDataflowConfigurationDetails.

• num_executors (int) – The value to assign to the num_executors property of this PipelineDataflowConfigurationDetails.

• warehouse_bucket_uri (str) – The value to assign to the warehouse_bucket_uri property of this PipelineDataflowConfigurationDetails.

• logs_bucket_uri (str) – The value to assign to the logs_bucket_uri property of this PipelineDataflowConfigurationDetails.

property configuration

Gets the configuration of this PipelineDataflowConfigurationDetails. The Spark configuration passed to the running process.

Returns

The configuration of this PipelineDataflowConfigurationDetails.

Return type

object

property driver_shape

Gets the driver_shape of this PipelineDataflowConfigurationDetails. The VM shape for the driver.

Returns

The driver_shape of this PipelineDataflowConfigurationDetails.

Return type

str

property driver_shape_config_details

Gets the driver_shape_config_details of this PipelineDataflowConfigurationDetails.

Returns

The driver_shape_config_details of this PipelineDataflowConfigurationDetails.

Return type

oci.data_science.models.PipelineShapeConfigDetails

property executor_shape

Gets the executor_shape of this PipelineDataflowConfigurationDetails. The VM shape for the executors.

Returns

The executor_shape of this PipelineDataflowConfigurationDetails.

Return type

str

property executor_shape_config_details

Gets the executor_shape_config_details of this PipelineDataflowConfigurationDetails.

Returns

The executor_shape_config_details of this PipelineDataflowConfigurationDetails.

Return type

oci.data_science.models.PipelineShapeConfigDetails

property logs_bucket_uri

Gets the logs_bucket_uri of this PipelineDataflowConfigurationDetails. An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded.

Returns

The logs_bucket_uri of this PipelineDataflowConfigurationDetails.

Return type

str

property num_executors

Gets the num_executors of this PipelineDataflowConfigurationDetails. The number of executor VMs requested.

Returns

The num_executors of this PipelineDataflowConfigurationDetails.

Return type

int

property warehouse_bucket_uri

Gets the warehouse_bucket_uri of this PipelineDataflowConfigurationDetails. An Oracle Cloud Infrastructure URI of the bucket to be used as default warehouse directory for BATCH SQL runs.

Returns

The warehouse_bucket_uri of this PipelineDataflowConfigurationDetails.

Return type

str