Bookshelf Home | Contents | Index | Search | PDF | ![]() ![]() ![]() ![]() |
Siebel Data Warehouse Installation and Administration Guide > Administering and Troubleshooting the Siebel Data Warehouse > Administering the Informatica Repository >
Performing the ETL Process
The ETL process extracts the OLTP data, transforms it, and loads it into the OLAP.
To start the ETL process
- Make sure that there is no data in the Siebel Transaction Database table S_ETL_INC_STAT.
NOTE: Once you have started the full or incremental ETL process, do not truncate the data. In case of failure, use the Restart Sessions within the batches from the point where the failure occurred. If you cannot restart for any reason and should start from the beginning, truncate the data. See Troubleshooting the ETL Process.
- If the language of the Siebel Transaction Database is not ENU, change the language value using the Siebel application's Application Administration screen.
- In the Siebel application, navigate to Application Administration > System Preferences.
- Perform a query for ETL Default Language.
- Change the value to the language code of the OLTP system.
To do a full load
- Make sure Informatica service is running.
- Make sure that no clients are accessing reports.
- Run the Informatica Server Manager and connect to the repository using the Administrator account.
- Open the Siebel_DW_Rep folder.
- (Optional, but recommended.) Right-click the batch named Exception_Reports and start it. When it completes, view the results in the Siebel Analytics' Analytics Administration view. For more information, read Using the Exception Report and Diagnostic Views.
- Right-click the batch named Full_Extract_Siebel_DW and select Start.
Wait until you see a message display on the output window, then wait one or two more minutes before continuing to next step. The displayed message "Request to start batch is unsuccessful in the message window" is normal behavior.
- Full_Extract_Siebel_DW_Dimension
- Full_Load_Siebel_DW_Dimensions
- Full_Load_Siebel_DW_Facts
- Full_Load_Siebel_DW_SCD (Optional if you want to track the Dimensions described in Step 9 by the attributes)
- Load_Aggregates
- Load_Pipeline
- Visibility_Intial_load (Optional, if you want data level security)
- Right-click the batch and start it.
- Monitor the load process. For information on monitoring, read Informatica's Administrator Guide.
- If the load process fails, stop it by right-clicking the batch name and choosing Stop. Check the log and fix the problem.
- Find the last entry of "RestartNextBatch #" before the failed session, and restart the batch process from that point. Continue monitoring the load process.
To monitor the ETL process
- Click the Poll sessions icon to monitor the process.
Watch the monitor window and wait until it completes the last session, which is Extract_Completed, before continuing to the next step.
- In the monitor window, click on the Completed Time column.
Click the Poll sessions icon again so that the triangle is pointing down. This method allows you to see the latest completed sessions at the top of the list.
Poll Sessions auto-refresh the monitoring tool and the monitor window approximately every 30 seconds.
- When Full_Extract_Siebel_DW batch is finished, click Stop Polling icon to stop the monitoring the sessions.
- Right-click the batch named Full_Load_Siebel_DW_Dimensions and select start. While you wait for it to communicate to the server and fetch data, go to the next step to see when it will finish fetching data.
NOTE: The batch is started even though the status message is "Request to start batch is unsuccessful."
To check the status of the request to start the batch
- Verify that the loading process has started by opening Repository Manager and connect to the repository as Administrator.
- In Repository Manager, select Edit > Show Locks.
- In Object Locks window, click the Refresh button about every half minute to see the change in Object Name field.
The Lock Type field should be Fetch.
Repeat clicking Refresh until you see Execute in the Type field.When the Lock Type field shows Fetch, the sessions are loaded into memory. When the type changes to Execute, it means the process of loading sessions definition into memory is finished.
Continue to the next step and do Polling Sessions in Server Manager.
- Go back to Server Manager. Click the Polling sessions icon or click Server Request menu and select Start Polling.
Polling status will appear in the monitor window panel.
- Continue through the Batches in Table 6 until the Siebel Data Warehouse is created.
Bookshelf Home | Contents | Index | Search | PDF | ![]() ![]() ![]() ![]() |
Siebel Data Warehouse Installation and Administration Guide, Version 7.5, Rev. C Published: 18 April 2003 |