Analyzing and Cleansing Data for Sun Master Index

Extracting the Data Using Data Integrator

In this task, you verify the mapping from the source database to the staging database and then extract the data from source to staging. Before beginning this step, make sure your source database is running.


Note –

For more information about extracting and loading data using Data Integrator, see Designing Data Integrator Projects.


ProcedureTo Extract the Data Using Data Integrator

Before You Begin

Complete the instructions under Connecting to the Source Database.

  1. In the NetBeans Projects window, open one of the ETL collaborations that was generated from the Data Integrator Wizard.


    Tip –

    If one of the tables contains a field that is a foreign key to other tables, you should process that table first.


  2. Verify the mapping of the data fields to be extracted from the source tables to the appropriate fields in the target tables.


    Caution – Caution –

    A unique value must be mapped to the ObjectID column in each target table (where Object is the name of the object for which the table stores data). You can concatenate the source system and local ID of each incoming record to create a unique value, or you can define a custom function to populate the unique values.


  3. To delete a mapping, highlight the mapping line and press the Delete key.

  4. To map a field, click the arrow next to the source field name and drag it to the target field name.

  5. To configure the target tables, do the following for each target table:

    1. Select the target table and open its Properties panel (select Properties in the Window menu).

    2. Deselect Create Target Table.

    3. (Optional) Select Truncate Target Table.

  6. Save your work, and then click Run Collaboration on the ETL Collaboration Editor toolbar.


    Tip –

    If any errors occur, the error message appears in the output panel at the bottom of the window. To fix the collaboration, select a target table, open its Properties panel, and delete the value of the Target Join Condition property. Repeat this step for each target table. Save and rerun the collaboration.


  7. After the extraction process is complete, verify the data in the target database table by right-clicking each table on the canvas and then selecting Show Data.

    The data in the tables appears in the output panel.

Next Steps

Continue to Determining the Fields to Analyze.