Creating ingest jobs

Learn more by watching the video!

Follow these steps to import data into the Oracle Audience Segmentation data model.

Learn more about correctly formatting source files and ingest jobs so that you can successfully import data:

  • Ensure source files are formatted correctly by reviewing CSV file standards for Oracle Audience Segmentation and supported CSV parsers.

  • Review how to import empty or null data and the restrictions on empty/null data in the Oracle Audience Segmentation data model.

Create an ingest job

To create an ingest job:

  1. Click the Oracle icon Image of the application navigation button. Use it to access the different parts of Oracle Unity. in the bottom-right corner to open the navigation menu.
  2. Select Data feeds.
  3. In the top-right corner, click Create data feed, then select Ingest job.

The Create ingest job page is displayed.

Note: You can open and close the different sections on the page by clicking the Arrow An image of the arrow button. Use it to open and close sections on the page., or anywhere else in the section heading.

Step 1: Define job details

The job details section allows you to define how the ingest job will display in Oracle Audience Segmentation. You will also need to select the source of the data that Oracle Audience Segmentation will use.

To define the job details:

  1. Enter the details for the ingest job.
    • Name: Enter a name. The name must be 1 or more characters, up to a maximum of 50. Other than underscores (_) and hyphens (-), special characters are not allowed. The first character cannot be a space. You can use characters from all languages supported in the language settings.

    • Job ID: The unique system identifier for your job. You can't change this value after you create the job.

      • If the job name uses English characters, the Job ID field is auto-populated from the job name you enter. You can change this value before the job is created.
      • If the job name uses characters from another language supported in the language settings, the Job ID field will be left blank. You will need to enter a name using English characters.
    • Description: Enter a description. This field is optional, but it is highly recommended to add descriptions for any entity created. This helps all other users get additional context when using and navigating Oracle Audience Segmentation. The description can have a maximum of 512 characters with no restrictions on characters used. You can use characters from all languages supported in the language settings.
    • Source:  This is the source of the data you want to bring into Oracle Audience Segmentation. Use the drop-down list to view all the sources that have been created and make a selection. When you select a source, the details of the source will display. Review the details and make sure they are accurate and up to date. You can also create a new source by clicking Create source. Learn more about Creating sources.
  2. Once you have confirmed that the details are correctly configured, click Continue.

An image of the job details section

Step 2: Field mapping

Field mapping allows you to define how fields from your source files are mapped to the attributes in the data model.

After loading the field mapping for the ingest job, you will need to do the following:

  • Review the configurations and make changes as needed.
  • Define how the data that is ingested into Oracle Audience Segmentation will be formatted.

Load field mapping

Select if you want automated or manual field mapping.

Automated field mapping

To load an Oracle Responsys automated field mapping template, refer to the help topic on Setting up the import of data from Oracle Responsys.

Manual field mapping

To set up manual field mapping, you will need to do the following:

  • Create a source object
  • Add a sample file of the source fields

To create a source object:

  1. Under Manual, click Create source object.

    2. An image of the Create source object button

  2. Enter a name for the source object. The name must be 1 or more characters, up to a maximum of 50. Other than underscores (_) and hyphens (-), special characters are not allowed. The first character must be a valid letter. You can use characters from all languages supported in the language settings.

    3. An image of the Add source object dialog

    Important: The name you give the source object will determine the files that are processed when the job runs. For example, to import address data, make sure to include "address" in the source object name so that all files with "address" in the file name will be identified for import. If you select an Automatic file name pattern when configuring the source, Oracle Audience Segmentation will use the source object name to create the file name pattern. Oracle Audience Segmentation will include compressed files as well as files with a prefix or suffix when matching and importing files. Please be aware that the source object name you define is case sensitive.

If needed, you can edit or delete the source object. If you delete a source object, all field mappings configured for the source object will be deleted as well.

To edit or delete the source object:

  1. Next to the source object name, click the Action menu (An image of the action menu button. Use it to edit custom data objects.).

    2. An image of the action menu for the source object

  2. Select Edit or Delete.

To complete manual field mapping, prepare a sample file that meets the following requirements:

  • The sample file is in CSV or TXT format.
  • The delimiter defined in the custom regular expression for the source file matches the delimiter in the sample file.
  • The sample file is less than 100MB.

To add a sample file:

  1. Drag the sample file to the sample file section or click Browse and select the file on your computer. You have the option of adding sample values to the fields.

    2. An image showing where to add a sample file

  2. Click Start mapping.

    3. After adding a sample file, click Start mapping.

  3. Follow the steps below to start mapping source object fields to data model attributes.

Mapping source object fields to data model attributes

Notes: You cannot access or search for hidden data objects and attributes for field mapping. Learn more about Hidden data model items in ingest jobs.

To map source object fields to data model attributes:

  1. For each of the mapped source fields, click Edit An image of the edit button. Use it to complete field mapping for ingestion jobs. to start adding attributes from the data model.

    2. Click the pencil icon to start adding attributes

  2. A list of recommended attributes may display for you to add. You can also use the search field to find attributes to add. You can search by data object name, attribute name, or attribute description.

    3. An image showing recommended attributes and the search field

  3. If you need to add an attribute that is not currently part of the data model, click Create attribute. Attributes you create will need to be published before the ingest job runs. You can review attributes that need to be published by clicking the checkbox for Show unpublished attributes. Learn more about Creating attributes and Publishing changes.

    4. An image showing the Create attribute button and checkbox for viewing unpublished attributes

  4. To add the attribute, click the Checkmark An image of the checkmark button. Use it to confirm field mapping for ingestion jobs..
  5. To add a transformation on an attribute, click Transform.

    6. An image showing the data transformation link

    Learn more about the different transformations available:

  6. To add another source object to be mapped, click Add source object.

Important notes about configuring field mapping

  • A single source field can be mapped to one or more data model attributes. Conversely, one or more source fields can be mapped to a single data model attribute. If you map multiple source fields to a single data model attribute, you want Oracle Audience Segmentation to store multiple values in that one data model attribute. Because of this, you need to ensure you select the appropriate transformation, so that Oracle Audience Segmentation can correctly combine those multiple values.

  • A notification will display if not every data object used in a mapping has its source mapped to an incoming field. Mapping all source data object IDs ensures that duplicate data is removed before it is stored in the system. Review the Source data object IDs not mapped notification before completing field mapping. The notification will identify each unmapped data object with a color.

    •  An image showing the notification of unmapped source data object IDs

    • A red circle indicates that the unmapped source data object ID (SourceXID attribute) will cause the ingest job to not import the data successfully, even if the ingest job successfully completes. This is because the Incoming records flag for the data object is set to No (insertOnly parameter set to false). Learn more about the Incoming records flag.

      • Example: You map the First name attribute from the Customer data object to the FirstName source field in the sample file. You must also map the corresponding SourceCustomerID attribute in the Customer data object to a source field in the sample file so that the data can be successfully imported. This is because the Incoming records flag for the Customer data object is set to No.

    • A yellow circle indicates that the source data object ID (SourceXID attribute) is unmapped, but the ingest job will still successfully import the data. This is because the Incoming records flag for the data object is set to Yes (insertOnly parameter set to true). If the SourceXID attribute is not mapped, Oracle Audience Segmentation will automatically add a unique identifier to the SourceXID attribute when the data is imported. Learn more about the Incoming records flag.

      • Example: You map the Order Total attribute from the Event data object to the OrderTotal source field in the sample file, but you don’t map the SourceEventID attribute to a source field. You will receive a warning the source data object ID is unmapped, but the ingest job will still be able to import the data successfully. This is because the Incoming records flag for the Event data object is set to Yes.

Managing source fields

You can create new source fields if you need to update the field mapping for an existing ingest job. To search through the existing list of source fields, click Find An image of the Find button. Use it to search for data objects. next to Source fields.

You can also edit and delete existing source fields if you need to update the name of the field or remove fields that you no longer need for the ingest job. Source fields you delete will also remove any field mappings you configured for that field.

To create new source fields:

  1. Next to Source fields, click Add Image of the add button. Use it to create a new source field..

    2. An image of the add source field icon

  2. Enter the name of the source field. You can use characters from all languages supported in the language settings.
  3. Click the Checkmark An image of the checkmark button. Use it to confirm the new source field..

    4. Click the checkmark to add the source field

  4. Update the source field as needed by mapping it to data model attributes.

To edit source fields:

  1. Hover your mouse over the source field name you want to update and click Edit An image of the edit icon.
  2. Enter the new source field name and click the checkmark An image of the checkmark icon. You can use characters from all languages supported in the language settings.

To delete source fields:

  1. Hover your mouse over the source field name you want to remove and click Delete An image of the delete icon.
  2. Review the confirmation message and click Yes.

Step 3: Schedule and notify

You will need to configure the schedule and notification settings for the ingest job.

An image of the Schedule and notify section

To schedule the ingest job and define the notification settings:

  1. Configure the schedule for the ingest job:
    • Click Recurring to automatically run the job on a regular schedule. If a job is still running while the next one is scheduled to run, the next scheduled run will not start until the current one completes. Two scheduled instances of the same ingest job can't run simultaneously.
    • Click On demand to run the job as needed.
  2. If the job is recurring, select the Frequency, Start time, and Days it will run.
  3. In the field for Notify, enter the email addresses of people to be notified when the job runs. You can use characters from all languages supported in the language settings. Separate multiple emails with a comma.

    4. Please note that the metrics for ingest jobs in notification emails are approximations and will not always be 100% accurate.

  4. If you only want a notification if the job fails, click the checkbox for Only notify on failure.

Step 4: Save and publish the ingest job

After saving the ingest job you will need to publish the changes before it can run.

To save and publish the ingest job:

  1. Scroll to the top of the page and click Save or Save and close.
  2. Follow the steps for Publishing changes.

When the publishing task is completed, the ingest job can run. Learn more about Managing ingest jobs.

Learn more

Managing ingest jobs

Creating export jobs

Managing export jobs

Managing data feeds

Managing the Jobs dashboard

Creating attributes

Publishing changes

ingest, ingest job, create ingest job, source, import, import job, create import job, importing data, ingesting data