Load commands load external data into the system. Integrated Operational Planning loads data into a new sandbox, thereby not affecting the base sandbox. Upon successful load and calculation, isadmin commands can submit the changes to the base sandbox.
Load commands include:
Each step can specify the semantics of the load in the corresponding command. Integrated Operational Planning supports these semantics:
Update—For each input row, compose the record using the target’s key columns, and search for that record in the target. If the key exists, replace all non-key values in the target row with values from the input row. If the key does not exist, add the input row.
Clear—Clear the stage tables. The combination of clear and update commands are same as the replace command.
Integrated Operational Planning uses update when the input data stream is incremental; for example, inventory at the end of the current week. Replace is used when the data stream is a complete snapshot of the data in the external system.
Always do a “stage replace” even for incremental data streams. The load update of row source incrementally updates the row source. |
Staging is not done inside a sandbox, and the stage tables are common resources. As a result, stage commands are normally placed outside the sandbox. |
The following commands deal with incremental data streams. The commands do a stage replace followed by a load into row sources and cubes.
# The model group concept is similar to that of dimensions. The # stagemaps for row sources are also grouped using different names. # It is important to match this name with that in the stagemap. # Otherwise, skip those row sources.stage replace using modelgroup "Bootstrap-Rowsource-Stagemaps" # create sandbox, load all row sources, calculate and submit sandbox # The macro definitions allow us simplify the commands and the system # resolves the names of all row sources to be loaded. # When you create sandbox in the following command, you set a new sandbox to be the current sandbox in current session and is applicable to all # subsequent commands. When sandbox is submitted, the current sandbox # gets reset to base sandbox.
create sandbox "data_bootstrap" alter sandbox set batch mode load update rowsources alter sandbox calculate submit sandbox
The following commands stage and replace a single row source:
stage replace using stagemap IN_MEDIA_METADATA_SM" create sandbox "media_meta_sb" alter sandbox set batch mode" load replace rowsource IN_MEDIA_METADATA_RS" alter sandbox calculate submit sandbox
The following command clears the stage tables of row sources. Any subsequent update is like a replace:
stage clear rowsources