How can I chunk high-volume XML data?
The HCM Extracts diagnostics enables you to split high-volume XML data into multiple smaller chunks to reduce the time and memory used for processing high-volume data.
Use the XML data chunking feature of Business Intelligence Publisher (BIP) when you face an issue that disables a business-critical process while running reports for large volumes of data.
The XML data chunking process involves the following stages:
- Schedule the Extracts data chunking process
- Create a BIP report based on the predefined data model to generate an output
- Schedule a BIP job to deliver the output remotely
- (Optional) Automate the Extracts SFTP delivery option to deliver the data chunks
Schedule Extracts data chunking process
Use BIP to generate and deliver data outputs
(Optional) Automate delivery option to deliver data chunks
- Open the extract definition and click the Deliver tab.
- Add a new delivery option with the delivery type FTP.
- The delivery option will keep the same report and template names. Enter the remote directory path and SFTP server name.
- Delete the Extract Delivery Mode additional details created for the newly added delivery option.
- Validate and save the extract definition.
- Follow the steps mentioned above to run the data chunking process and provide the delivery option name to trigger automatic delivery to an SFTP server.