Skip to Main Content
Return to Navigation

Working with the ETL Field Lineage Dashboard

Use the ETL Field Lineage dashboard to perform field level impact analysis and view each phase of the ETL mapping process, tracing how facts or dimensions are derived from the source system as the tables and columns undergo the transform and load processes to the EPM warehouse.

Image: ETL Field Lineage dashboard

ETL Field Lineage dashboard

data_lineage_ETLFieldLineageDash_WelcomePage

Usage

Reports

Field Lineage – High Level versus Detail

Provides field level impact analysis and a view of each phase of the ETL mapping process, tracing how facts or dimensions are derived from the source system as the tables and columns undergo the transform and load processes to the EPM warehouse.

This dashboard is comprised of the following pages:

  • Welcome

  • Field Impact Analysis

  • Field Lineage – High Level

  • Field Lineage – Detail Level

Note: The Welcome page provides descriptions of the pages included in this dashboard and is not discussed in this documentation.

When you select the Record Field Name/Record/Server Job column prompt values:

  • The Field Lineage – High Level report displays field lineage flow only for the actual source field mapped to the selected record field in the selected ETL job.

  • The Field Lineage – Detail Level report displays all the source fields used to derive the selected record field in the selected server job that loads the selected EPM record at Level 1.

Using the Field Impact Analysis Page

Access the Field Impact Analysis page, which enables you to analyze the tables, ETL jobs, and EPM warehouses impacted by a specific field.

Image: Field Impact Analysis page

Field Impact Analysis page

data_lineage_ETLFieldLineageDash_FieldImpactAnalysisPage

The following table provides column descriptions for the Field Impact Analysis page:

Column

Description

Warehouse

Displays the EPM warehouses where the selected field is used.

Mart

Displays the marts where the selected field is used.

Subject Area

Displays the (mart) subject areas where the selected field is used.

Record

Displays the EPM table where the selected field is used.

Click a record to access the EPM Record Details page and analyze field level data, transformation logic, and load strategy for the EPM table.

Server Job

Displays the ETL server jobs where the selected field is used.

Click a server job to access the Field Lineage – High Level page and analyze how the selected field is derived from the source system as it undergoes the transform and load processes to the EPM warehouse.

Source Field List

Displays a list of source fields used to derive the selected field.

Drilling in the Field Impact Analysis Page

In the Field Impact Analysis page you can click a record to access the EPM Record Details page and analyze field level data, transformation logic, and load strategy for the EPM table. For example, the following page represents drill down information for the table PS_D_ACAD_PLAN:

Image: Drilling in the Field Impact Analysis page (EPM Record Details page)

Drilling in the Field Impact Analysis page (EPM Record Details page)

data_lineage_ETLFieldLineageDash_FieldImpactAnalysisPage_ETLJobDrillDown

You can also click an ETL job to access the Field Lineage – High Level page and analyze how the corresponding fact or dimension is derived in the ETL job. For example, the following page represents drill down information for the ETL job J_Dim_PS_D_ACAD_PLAN and dimension PS_D_ACAD_PLAN:

Image: Drilling in the Field Impact Analysis page (Field Lineage - High Level page)

Drilling in the Field Impact Analysis page (Field Lineage - High Level page)

data_lineage_ETLFieldLineageDash_FieldImpactAnalysisPage_RecordDrillDown

Using the Field Lineage – High Level Page

Access the Field Lineage – High Level page, which enables you to view the different phases of the ETL mapping process for a particular EPM table and field, and understand how that field is derived in the selected ETL job from the source system as it undergoes the transform and load processes to the EPM warehouse.

Image: Field Lineage – High Level page

Field Lineage – High Level page

data_lineage_ETLFieldLineageDash_FieldLineageHighLevelPage

The results section of the Field Lineage – High Level page displays the entire flow of source fields used to derive the selected EPM record field, including PeopleSoft source system fields. The results section displays ‘levels,’ which represent the progression of the field lineage at each stage of the process:

  • Level 1: The Level 1 group box displays the final stage of the field lineage, that is, source fields used to derive the selected EPM record field in the selected ETL job.

  • Level 2: The Level 2 group box displays the source fields used to derive the source fields in Level 1.

  • Subsequent Levels: Subsequent levels display the initial stages of the field lineage, usually the source fields from the PeopleSoft source system used to derive the source fields in Level 2.

Viewing the different phases of the field lineage process enables you to understand how a particular EPM fact or dimension is derived from the source system as it undergoes the transform and load processes to the EPM warehouse.

The following table provides column descriptions for the Field Lineage – High Level page:

Column

Description

Server Job

At Level 1, displays the ETL job that contains the user selected EPM Field.

In subsequent levels, displays the ETL job in which the source fields at the previous level are derived.

Target Record Schema

At Level 1, displays the EPM schema (layer) that contains the user selected EPM field.

In subsequent levels, displays the EPM schema (layer) of the source record used to derive the target field at the previous level.

Target Record

At Level 1, displays the EPM table that contains the user selected EPM field.

In subsequent levels, displays the EPM table used to derive the target field at the previous level.

Target Field

At Level 1, displays the user selected EPM column.

In subsequent levels, displays the source columns used to derive the target column at the previous level.

Click a target field to access the Dashboard Analysis page and analyze the relationships between selected column and its related OBIEE dashboards, reports, and Presentation and Physical layers within the OBIEE metadata repository.

Source Record Schema

Displays the source schema (layer) associated with the source table, which is used to derive the target field.

Source Record

Displays the source table used to derive the target field.

Source Reference Type

Indicates whether the source field used to derive the target field belongs to a lookup table or source table in the ETL job.

Source Field

Displays the source field used to derive the target field.

Source Field Index

This number uniquely identifies a particular source field for the selected EPM record field in the selected ETL job at a particular level.

At Level 1, displays a unique number (starting at 1) for the source fields used to derive the target field.

In subsequent levels, it can be used as an index to track the field lineage information flow based on the prefixed source field indexes at previous levels.

Field Derived Logic

Displays the derived logic implemented in the ETL job for the EPM record field. Typically data is available for fields with hard-coded values.

Drilling in the Field Lineage – High Level Page

In the Field Lineage – High Level page you can click a target field to access the Dashboard Analysis page and analyze the relationships between the selected column and its related OBIEE dashboards, reports, and Presentation and Physical layers within the OBIEE metadata repository.

For example, the following page represents drill down information for the target column ACAD_CAR_LD:

Image: Drilling in the Field Lineage – High Level page (Dashboard Analysis page)

Drilling in the Field Lineage – High Level page (Dashboard Analysis page)

data_lineage_ETLFieldLineageDash_FieldLineageHighLevelPage_TargetFieldDrillDown

Using the Field Lineage – Detail Level Page

Access the Field Lineage – Detail Level page, which enables you to analyze detailed field lineage information used to derive the selected EPM record field for a particular ETL job.

Image: Field Lineage – Detail Level page, part 1

Field Lineage – Detail Level page, part 1

data_lineage_ETLFieldLineageDash_FieldLineageDetailLevelPage1

Image: Field Lineage – Detail Level page, part 2

Field Lineage – Detail Level page, part 2

data_lineage_ETLFieldLineageDash_FieldLineageDetailLevelPage2

The results section of the Field Lineage – Detail Level page displays all the source tables/fields used to derive the selected EPM table field in the selected ETL job. By default, Level 1 displays only the source fields used to derive the selected EPM table field in the selected ETL job.

However, you can view additional level (lineage information) for each source field in Level 1 by selecting the field’s corresponding source field index. Source Field Index is a unique number to identify a particular source field for the selected EPM record field in the selected ETL job, at a particular level.

The following table provides column descriptions for the Field Lineage – Detail Level page:

Column

Description

Server Job

At Level 1, displays the ETL job that contains the user selected EPM Field.

In subsequent levels, displays the ETL job in which the source fields at the previous level are derived.

Target Record Schema

At Level 1, displays the EPM schema (layer) that contains the user selected EPM field.

In subsequent levels, displays the EPM schema (layer) of the source record used to derive the target field at the previous level.

Target Record

At Level 1, displays the EPM table that contains the user selected EPM field.

In subsequent levels, displays the EPM record used to derive the target field at the previous level.

Target Field

At Level 1, displays the user selected EPM column.

In subsequent levels, displays the source column used to derive the target column at the previous level.

Click a target column to access the Dashboard Analysis page and analyze the relationships between the selected column and its related OBIEE dashboards, reports, and Presentation and Physical layers within the OBIEE metadata repository.

Source Record Schema

Displays the source schema (layer) associated with the source table, which is used to derive the target field.

Source Record

Displays the source table used to derive the target field.

Source Reference Type

Indicates whether the source field used to derive the target field belongs to a lookup table or source table in the ETL job.

Source Field

Displays the source field used to derive the target field.

Source Field Index

This number uniquely identifies a particular source field for the selected EPM record field in the selected ETL job at a particular level.

At Level 1, displays a unique number (starting at 1) for the source fields used to derive the target field.

In subsequent levels, it can be used as an index to track the field lineage information flow based on the prefixed source field indexes at previous levels.

Click a source field index to view additional levels (lineage information) for each source field.

Field Derived Logic

Displays the derived logic implemented in the ETL job for the EPM record field. Typically data is available for fields with hard-coded values.

Drilling in the Field Lineage – Detail Level Page

In the Field Lineage – Detail Level page you can click a target field name to access the Dashboard Analysis page and analyze the usage of the selected column within OBIEE dashboards, and presentation/physical layers within the OBIEE metadata repository. For example, the following page represents drill down information for the field ACAD_CAR_LD:

Image: Drilling in the Field Lineage – Detail Level page (Dashboard Analysis page)

Drilling in the Field Lineage – Detail Level page (Dashboard Analysis page)

data_lineage_ETLFieldLineageDash_FieldLineageHighLevelPage_TargetFieldDrillDown