Prerequisites to Creating Warehouse Business Units
This topic provides you with prerequisites to creating warehouse business units and discusses how to:
Run prerequisite ETL setup jobs.
Size tablespaces for input tables.
Create backups of impacted output tables.
Enable PS Queries
Verify the state of output tables
Validate business unit and set control data
Verify source blueprints
Running Prerequisite ETL Setup Jobs
Before you can begin creating warehouse business units you must run specific ETL jobs that setup certain OWS and OWE tables, and bring your source business unit data into EPM tables. Some of these jobs include OWS hash file, setup OWS, shared lookup, and setup OWE jobs.
The general OWS and OWE ETL setup jobs are not discussed here because the information is covered in another topic of this documentation. However, the ETL jobs that are specific to business unit data are discussed below.
See Understanding IBM WebSphere DataStage Setup and Configuration and Verifying ETL Components Have Imported Properly.
Running Hash File - Business Unit Data Jobs
To run the hash file jobs that pertain to business unit data:
In DataStage Director, navigate to the hash file jobs for business unit data using the following navigation: Setup_E, Dimension_Mapper, Base, Load_Hash_Files, Server.
Select the jobs in this category and run.
Running Setup - Business Unit Tables Jobs
To run the setup jobs that load business unit setup tables:
In DataStage Director, navigate to the hash file jobs for business unit data using the following navigation: Setup_E, Dimension_Mapper, Base, Load_Tables, Sequence.
Select the jobs in this category and run.
Running Shared Lookup - Business Unit Data Jobs
To run the shared lookup jobs that pertain to business unit data:
In DataStage Director, navigate to the shared lookup jobs for business unit data using the following navigation: Shared_Lookups, DimensionMapper_Lookups
Select the jobs in this category and run.
Sizing Tablespaces for the Input Tables
The Business Unit Creation Wizard input tables use the EWLARGE tablespace , while the PSINDEX tablespace is used for indexes. These table spaces should be large enough to store the data in input, output and intermediate tables related to warehouse business unit creation.
A good rule of thumb is to make sure that each of the two tablespaces are at least twice the size of the PF_SRC_SETCNTRL table. Determine the maximum size for a row of data in PF_SRC_SETCNTRL by examining this table in your database. Estimate the number of rows expected in this table, and then multiply these factors together. Double the result to get a minimum tablespace size estimate: Minimum tablespace size = 2 * #Rows * Size of one row of PF_SRC_SETCNTRL.
Creating Backups of Impacted Output Tables (Optional)
Create a DAT file backup of the output tables that are impacted by the warehouse business unit creation process. That way, if you encounter problems during the creation process you can use the DAT file to roll back your system.
Run the prepackaged Data Mover script DMBK_CREATE_DM_BACKUP to produce the backup DAT file of the impacted output tables. The following are the output tables backed up by the DAT file:
SETID_TBL
SET_CNTRL_TBL
SET_CNTRL_GROUP
SET_CNTRL_REC
BUS_UNIT_TBL_FS
BUS_UNIT_TBL_PF
BUS_UNIT_TBL_GL
PF_BUS_UNIT_MAP
PF_SETID_LOOKUP
To roll back your system, run the Data Mover script DMBK_RESTORE_TABLES.
Enabling PS Queries for Data Verification
The following topics provide instructions on how to verify different aspects of your business unit related data. To perform the verifications you must run certain prepackaged PS Queries. To obtain the specific queries you must first enable the queries and the query security by installing the DMRP_QUERIES Application Designer project.
Perform the following steps to install the DMRP_QUERIES project and enable prepackaged PS Queries:
Locate the DMRP_QUERIES Application Designer project on My Oracle Support and install it.
In PIA navigate to QUERY_TREE_EW using the following path: PeopleTools, Security, Query Security, Query Access Manager.
Enter QUERY_TREE_EW for the tree name and search.
Click the QUERY_TREE_EW link from the grid to access.
Click the Insert Child Group button.
Enter DM_RED_PAPER _GROUP for the access group and add.
Enter Dimension Mapper Red Paper for the description and click OK.
Select the DM_RED_PAPER _GROUP - Dimension Mapper Red Paper link and click the Insert Child Record button.
Enter BUS_UNIT_SRC_PF for the record and add.
Repeat the steps to insert the following records:
PF_BLUEPR_DFN
PF_BLUEPR_DTL
PF_BUS_UNIT_MAP
PF_SCR_TBL
PF_SETID_LOOKUP
PF_SRC_BU_NAMES
PF_SRC_BU_ROLES
PF_SRC_LINEAGE
PF_SRC_SETCNTRL
PF_SSCL_DFN
PF_SSCL_DTL
SRC_SYSTEM_TBL
Click Save.
Once the queries are installed you can access them as follows:
In PIA navigate to the queries using the following path: Reporting Tools, Query, Query Viewer.
Enter DMRP in the search box.
Click on the HTML link next to the query of your choice to view the results in a browser window.
Verifying the State of Output Tables (Optional)
The prepackaged PS Queries enable you to inspect the state of the output tables that Dimension Mapper populates. If you are populating a warehouse for the first time, the output tables are empty of data except for the set control tables MODEL and SHARE, which will contain SetID data.
If you are upgrading an existing warehouse, the tables are populated with data from all previously installed products. Existing warehouse business units can have an impact on the setup process if you map incoming business unites to existing warehouse business units. The Business Unit Creation Wizard respects the SetID assignments of the existing warehouse business units and attempts to correlate the incoming SetIDs and the existing SetIDs on the appropriate record groups. If, for some reason, extraneous business units exist in the warehouses, unwanted SetID mappings may be created.
For example, if you manually create a business unit named US01 in the OWE, you must assign a SetID to US01 on all warehouse record groups. A default SetID is required at business unit creation time, although you can manually reassign the SetID for US01 on any warehouse record group by accessing the PeopleTools pages (should you wish).
If you bring in another source business unit (assume it is also named US01), and you map the two together, the system attempts to create mappings between the SetIDs used by US001 in the source, and the SetIDs used by US001 in the OWE. These mapping are then validated to ensure that no SetID conflicts exist. If the US001 entry in the warehouse is in fact erroneous (demo data, for example), then you may create unnecessary conflicts that will impact the setup process.
Likewise, if you bring in a SetID such as SHARE, and SHARE already exists in the warehouse, the Business Unit Creation Wizard prompts you to merge the two SetIDs. If you select yes, then any SetID assignments that SHARE itself might have in the source will be mapped to the existing SetID assignments that SHARE has in the warehouse. This "second-order" indirection is utilized by some applications to enable advanced prompting features. Consequently you should make sure that you do not have erroneous WBUs or SetIDs prior to running Dimension Mapper.
For these reasons, it is important to check the state of the output tables because existing business units and SetIDs impact how incoming business units and SetIDs from the source are mapped to their warehouse counterpart.
To inspect the state of the relevant input tables, you can use the following PS Queries:
PS Query Object |
Description |
---|---|
DMRP_1_1_SET_CNTRL_REC |
View the values for SET_CNTRL_REC. |
DMRP_1_2_SET_CNTRL_GROUP |
View the values for SET_CNTRL_GROUP. |
DMRP_1_3_SET_CNTRL_TBL |
View the values for SET_CNTRL_TBL. |
DMRP_1_4_SETID_TBL |
View the values for SETID_TBL. |
DMRP_1_5_BUS_UNIT_TBL_PF |
View the values for BUS_UNIT_TBL_PF. |
DMRP_1_6_BUS_UNIT_TBL_FS |
View the values for BUS_UNIT_TBL_FS. |
DMRP_1_7_BUS_UNIT_MAP |
View the values for BUS_UNIT_MAP. |
DMRP_1_8_SETID_LOOKUP |
View the values for SETID_LOOKUP. |
Validating Business Unit and Set Control Data
Before you can begin creating warehouse business units or using the Business Unit Creation Wizard, you must run specific ETL job that setup the OWS, OWE, and common tables, and bring in your source business unit data. Use the PS Queries listed in the following sections to ensure that the appropriate setup jobs have been executed, the necessary data resides in your tables, and there is no corrupt data.
Source Business Unit Data
Run the queries listed below to ensure your source business unit data is present in EPM. All business units from each source should be present. If any are missing, check the ETL jobs and run again. If extraneous business units are present (perhaps you imported the wrong data) then you will have to truncate the PF_SRC_BU_NAMES table manually.
PS Query Object |
Description |
---|---|
DMRP_3_1_SRC_BU_NAMES |
This query lists the source business units that are present in PF_SRC_BU_NAMES. |
DMRP_3_2_SRC_BU_ROLES |
This query lists the roles present in PF_SRC_BU_ROLES. A role is a associated with a business unit and relates to the type of business unit, such as accounts payable (AP), financial (FS), general ledger (GL), or inventory (INV). Each source BU can have one or more roles. Note: All business units must have the FS role. |
DMRP_3_3_SETIDS |
This query identifies the source SetIDs. Any set control that is not present in the PF_SRC_BU_NAMES is interpreted as a SetID. Note: If all of your SetIDs are also used as business units in the source, no rows display. This does not indicate a problem. |
Source Set Control Data
Run the query DMRP_3_4_SRC_SETCNTRL to ensure your source set control data is present in EPM. Set control information from all source systems should be present in PF_SRC_SETCNTRL and the query provides a count of the number of rows of set control information for each source that you have extracted into the system.
The number of rows returned for this query vary depending on the number of SetID based and set control tables in your source. You can determine how many rows should be present in the query results by multiplying the number of SetID-based tables in each source by the number of set controls that you defined in that source. The number of set controls for a given source is equal to the number of business units in that source plus the number of SetIDs in that source.
For example, if you have an FSCM source with 30 business units and one SetID, you should expect approximately 129,363 rows [(30 BUs + 1 SetID) * (4,173) = 129,363]. If you have more than one pillar then repeat this calculation for each pillar and add up the totals. Your estimate should come very close to the results of the query, with a 10-15 percent deviation at most. If the results are significantly different, check the ETL process for errors.
The following table is provided for you to estimate the number of rows in PF_SRC_SETCNTRL.
Source System |
Number of SetID-Based Records |
Number of Set Controls in each Source |
Expected Number of Rows |
||
---|---|---|---|---|---|
CRM 9.0 |
1,350 |
* |
= |
||
ELM |
98 |
* |
= |
||
FSCM 9.0 |
4,173 |
* |
= |
||
HCM 9.0 |
784 |
* |
= |
Corrupt Source Data
Occasionally corrupt data can make its way into your source system (for example, someone enters data in the back-end rather than the using PIA pages, which control data quality). Corrupt data can affect your business units and set controls, and should not be allowed to enter EPM. As such, the following queries are provided to capture some business unit and set control error conditions:
PS Query Object |
Description |
---|---|
DMRP_4_1_DANGLING_BU |
Identifies any occurrences of business units that are not found in the Source Set Control table. Note: The Business Unit Creation Wizard does not create warehouse business units for source business units that do not appear in the Business Unit Names table. You must create these business units manually. |
DMRP_4_2_BAD_SETCNTRLS |
Identifies any business unit names that are greater than five character in length, null, or contain only a dash. These values must be removed or the validation step of the Business Unit Creation Wizard may hang indefinitely, causing the system to time-out. |
Verifying Source Blueprints
Source blueprints are vital in determining warehouse lineage and are delivered as system (SYS) data in EPM. Use the DMRP_2_2_BLUEPR_DFN query to confirm that the blueprints are present in the EPM system and populated with the correct data.
The table, PF_BLUEPR_DFN, should contain rows for all supported source systems. You should have the following number of rows for each source system:
CRM90: 50
FSCM90: 174
HCM90: 69
NONSETID: 1
Note: These numbers may change slightly due to updated bundle fixes.