Data Extraction

The system enables you to extract the data from the system in the CSV file through a batch control named C1-DTEX. While extracting the data through the C1-DTEX batch, you need to specify the data extract request type using which you want to create the data extract request. The data extract request type indicates the business object whose data you would like to extract at the predefined location. The system then derives the data created using the business object from each table associated with the respective maintenance object. A separate CSV file is created for each table from where the data is extracted. Let us understand this with the help of an example.

While extracting the data for the C1_​BILL_​BO business object, the system will extract the data from each table associated with the BILL maintenance object and will create one CSV file for each table (i.e., CI_​BILL, CI_​BILL_​CHAR, CI_​BILL_​EXCP, CI_​BILL_​MSG_​PRM, CI_​BILL_​MSGS, CI_​BILL_​ROUTING, CI_​BILL_​SA) and one file to record the errors (if any).

For example, if you extract the bill information using the DEXT data extract request type where the business object is set to C1_​BILL_​BO, the system will create the following CSV files at the predefined location:

• DEXT_​BILL_​CI_​BILL_​07-01-2023_​243.csv

• DEXT_​BILL_​CI_​BILL_​CHAR_​07-01-2023_​243.csv

• DEXT_​BILL_​CI_​BILL_​EXCP_​07-01-2023_​243.csv

• DEXT_​BILL_​CI_​BILL_​MSG_​PRM_​07-01-2023_​243.csv

• DEXT_​BILL_​CI_​BILL_​MSGS_​07-01-2023_​243.csv

• DEXT_​BILL_​CI_​BILL_​ROUTING_​07-01-2023_​243.csv

• DEXT_​BILL_​CI_​BILL_​SA_​07-01-2023_​243.csv

• DEXT_​BILL_​ERROR_​07-01-2023_​243.csv

Here, the file naming convention used is as follows:

<Data_Extract_Request_Type>_<MO>_<Table_Name>_<Extraction_Date>_<Batch_Run_No>.csv 

The system allows you to extract data created using a business object only when it is set in the algorithm attached to Determine BO system event of the respective maintenance object. For example, while creating a data extract request type for the C1_​BILL_​BO business object, you need to ensure that the Business Object parameter in the algorithm attached to the Determine BO system event of the BILL maintenance object is set to C1_​BILL_​BO. Otherwise, the data created using the C1_​BILL_​BO business object will not be extracted through the data extract request type.

You need to define a data extract request type for each business object whose transactional or non-transactional data you want to extract. On extracting the data, all or filtered data (based on the condition) is extracted in the CSV file. The CSV file includes all the columns from the table including two additional columns named DT_​EXTRACT_​DTTM and RECORD_​STATUS. The DT_​EXTRACT_​DTTM column contains the date and time when the record is extracted from the table. On full data extraction, the system sets the RECORD_​STATUS column for each record in the CSV file to I (i.e., Add). However, on incremental data extraction, the system sets the RECORD_​STATUS column for each record in the CSV file to either I (i.e., Add) or U (i.e., Update) depending on whether the data is added or updated in the system since the last extraction.