Export Job File Splitting

As part of an export job, you can opt to create a single export file, or multiple export files by using the isConcurrent parameter on the destination.

• If the isConcurrent parameter is set to FALSE, the export job creates a single export file.

• If the isConcurrent parameter is set to TRUE, the export job creates a number of export files equal to or less than the partition count (if configured) or bucket count (depending on the size of the data object in MB). By default, or if omitted, the isConcurrent parameter is set to TRUE

Specify isConcurrent in the parameters section when updating a destination, as shown below.

{
  "tenantId": yourTenantId,
  "name": "sampleFTPSink",
  "versionTS": generated_timestamp,
  "description": "Sink for FTP",
  "active": true,
  "lastModifiedBy": userName,
  "createdTS": generated_timestamp,
  "componentDefinitionId": "FTPSink",
  "uniqueInstanceId": "sampleFTPSink",
  "parameters": {
    ....
    "isConcurrent": "FALSE|TRUE",
    ....
  }
  ...
}

Note: The segment export job doesn't support file splitting. A segment export job always produces a single export file.

Next steps

Update a Destination