The application ID.
A comma separated list of one or more archive files as Oracle Cloud Infrastructure URIs. For example, {@code oci://path/to/a.zip,oci://path/to/b.zip}. An Oracle Cloud Infrastructure URI of an archive.zip file containing custom dependencies that may be used to support the execution of a Python, Java, or Scala application. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.
The arguments passed to the running application as command line arguments. An argument is either a plain text or a placeholder. Placeholders are replaced using values from the parameters map. Each placeholder specified must be represented in the parameters map else the request (POST or PUT) will fail with a HTTP 400 status code. Placeholders are specified as {@code Service Api Spec}, where {@code name} is the name of the parameter. Example: {@code [ "--input", "${input_file}", "--name", "John Doe" ]} If "input_file" has a value of "mydata.xml", then the value above will be translated to {@code --input mydata.xml --name "John Doe"}
The class for the application.
The OCID of a compartment.
The Spark configuration passed to the running process. See https://spark.apache.org/docs/latest/configuration.html#available-properties. Example: { "spark.app.name" : "My App Name", "spark.shuffle.io.maxRetries" : "4" } Note: Not all Spark properties are permitted to be set. Attempting to set a property that is not allowed to be overwritten will cause a 400 status to be returned.
The data read by the run in bytes. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
The data written by the run in bytes. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {@code {"Operations": {"CostCenter": "42"}}}
A user-friendly name. This name is not necessarily unique.
The VM shape for the driver. Sets the driver cores and memory.
The input used for spark-submit command. For more details see https://spark.apache.org/docs/latest/submitting-applications.html#launching-applications-with-spark-submit. Supported options include {@code --class}{@code , }{@code --file}{@code , }{@code --jars}{@code , }{@code --conf}{@code , }{@code --py-files}{@code , and main application file with arguments. Example: }{@code --jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10} Note: If execute is specified together with applicationId, className, configuration, fileUri, language, arguments, parameters during application create/update, or run create/submit, Data Flow service will use derived information from execute input only.
The VM shape for the executors. Sets the executor cores and memory.
An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.
Free-form tags for this resource. Each tag is a simple key-value pair with no predefined name, type, or namespace. For more information, see Resource Tags. Example: {@code {"Department": "Finance"}}
The ID of a run.
The timeout value in minutes used to manage Runs. A Run would be stopped after inactivity for this amount of time period. Note: This parameter is currently only applicable for Runs of type {@code SESSION}. Default value is 2880 minutes (2 days) Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
The Spark language.
The detailed messages about the lifecycle state.
The current state of this run.
An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.
The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to {@code IN_PROGRESS} state. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
The OCID of OCI Hive Metastore.
The number of executor VMs requested. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
Unique Oracle assigned identifier for the request. If you need to contact Oracle about a particular request, please provide the request ID.
The OCID of the user who created the resource.
The username of the user who created the resource. If the username of the owner does not exist, {@code null} will be returned and the caller should refer to the ownerPrincipalId value instead.
An array of name/value pairs used to fill placeholders found in properties like {@code Application.arguments}. The name must be a string of one or more word characters (a-z, A-Z, 0-9, _). The value can be a string of 0 or more characters of any kind. Example: [ { name: "iterations", value: "10"}, { name: "input_file", value: "mydata.xml" }, { name: "variable_x", value: "${x}"} ]
The OCID of a pool. Unique Id to indentify a dataflow pool resource.
An array of DNS zone names. Example: {@code [ "app.examplecorp.com", "app.examplecorp2.com" ]}
The OCID of a private endpoint.
The maximum number of hosts to be accessed through the private endpoint. This value is used to calculate the relevant CIDR block and should be a multiple of 256. If the value is not a multiple of 256, it is rounded up to the next multiple of 256. For example, 300 is rounded up to 512. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
An array of network security group OCIDs.
The OCID of a subnet.
The duration of the run in milliseconds. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
The Spark version utilized to run the application.
The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: {@code 2018-04-03T21:10:29.600Z}
The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: {@code 2018-04-03T21:10:29.600Z}
The total number of oCPU requested by the run. Note: Numbers greater than Number.MAX_SAFE_INTEGER will result in rounding issues.
The Spark application processing type.
An Oracle Cloud Infrastructure URI of the bucket to be used as default warehouse directory for BATCH SQL runs. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.
A run object.