Submit a Map-Reduce Compute Job

post

/bdcsce/api/v1.1/clustermgmt/{identityDomainId}/instances/{clusterId}/jobs/mapred

Request

Path Parameters
Body ()
Definition of the Map-Reduce Job that you want to submit.
Root Schema : YarnMapReduceJobHttpRequest
Type: object
Show Source
Nested Schema : YarnMapReduceJob
Type: object
Show Source
Nested Schema : amCores
Type: object
Nested Schema : amEnv
Type: object
Additional Properties Allowed
Show Source
Nested Schema : amExtraJavaOptions
Type: array
Show Source
Nested Schema : amMemory
Type: object
Nested Schema : amMemoryOverhead
Type: object
Nested Schema : applicationArguments
Type: array
Arguments that need to be sent to the _Application Main_ or the _Application Script_.
Show Source
Nested Schema : applicationExtraLibraryPath
Type: array
Show Source
Nested Schema : applicationJarFiles
Type: array
List of jars that will be downloaded and added to the classpath of the given Job.
Show Source
Nested Schema : applicationSupportArchives
Type: array
Show Source
Nested Schema : applicationSupportFiles
Type: array
List of files that will be downloaded and collocated for the given Job.
Show Source
Nested Schema : applicationTags
Type: array
Show Source
Nested Schema : attemptFailuresValidityInterval
Type: object
Nested Schema : containerMemory
Type: object
Nested Schema : containerMemoryOverhead
Type: object
Nested Schema : env
Type: object
Additional Properties Allowed
Show Source
Map of environment variable that should be available to the Job containers.
Nested Schema : extraJavaOptions
Type: array
A map of extra JVM options to pass to the mapper and reducer. For instance, GC settings or other logging.
Show Source
Nested Schema : hadoopConf
Type: object
Additional Properties Allowed
Show Source
Map of Hadoop configuration options that will be used to submit the Job.
Nested Schema : mapCPUVCores
Type: object
Nested Schema : mapMemoryMB
Type: object
Nested Schema : maxAppAttempts
Type: object
Nested Schema : maxJobDurationInSecs
Type: object
Maximum duration of a Job in seconds. When a Job exceeds the amount of time the Job will be terminated.
Nested Schema : maxSubmissionLatencyInSecs
Type: object
The maximum waiting period that the requester is willing to wait for the job to actually start running inside a cluster before the Job is considered failed, REQUEST_TIMEOUT.
Nested Schema : reduceCPUVCores
Type: object
Nested Schema : reduceMemoryMB
Type: object
Security
Back to Top

Response

200 Response

Body ()
Root Schema : AsyncJobStatus
Type: object
Show Source
Nested Schema : JobAggregatedLogs
Type: object
Show Source
Nested Schema : JobAggregatedStoredLogs
Type: object
Show Source
Nested Schema : allocatedOCores
Type: object
Read Only: true
Sum of virtual cores allocated to the job???s running containers.
Nested Schema : applicationTags
Type: array
A collection of tags or labels associated with this job.
Show Source
Nested Schema : completed
Type: object
Read Only: true
Specifies whether the job has been completed. It can be used to determine whether the client needs to keep polling the -progress- status.
Nested Schema : connectors
Type: array
Connecting interfaces that this Job offers. An example of this connector will be the Spark UI.
Show Source
Nested Schema : containerLogs
Type: array
Location of log file(s) for a running job.
Show Source
Nested Schema : Error
Type: object
Show Source
Nested Schema : files
Type: array
Show Source
Nested Schema : JobLogFileReference
Type: object
Show Source
Nested Schema : files
Type: array
Show Source
Nested Schema : JobConnectorReference
Type: object
Show Source
Nested Schema : uris
Type: array
The URI of the linked resource
Show Source
Nested Schema : JobConnectorResourceIdentifier
Type: object
Show Source
Nested Schema : JobContainerLogs
Type: object
Show Source
Nested Schema : files
Type: array
Log files with path relative to the Container.
Show Source
Nested Schema : o:errorDetails
Type: array
Read Only: true
error details
Show Source

400 Response

List of errors related to the request.
Body ()
Root Schema : schema
Type: array
Show Source

404 Response

The Compute Job was not found.

500 Response

An internal error occurred.
Body ()
Root Schema : Error
Type: object
Show Source
Nested Schema : o:errorDetails
Type: array
Read Only: true
error details
Show Source
Back to Top