How can I enable data chunking for high-volume extracts?

Run the following payroll extracts for larger data sets using the XML Data Chunking feature of BI Publisher.

  • Payroll Activity Report for the Latest Process

  • Statutory Deduction Register for the Latest Process

  • Payroll Register for the Latest Process

Note: You can split large volumes of report output into manageable chunks of XML files, to ease parallel processing and later be merged into a single report. The XML data chunking capability in BI Publisher reduces the time and memory used for processing large data. You can't use this functionality for PDF and text output of the report.

Do the following to enable XML chunking:

  1. Use a process configuration group to enable BI Publisher to chunk the high-volume XML extract output.

  2. Create a Payroll Process Configuration Group. You'll use this process configuration group for running your Extracts and for processing the XML file.

  3. Add the parameter Split and Process large XML output Process configuration to enable BIP to split large XML output from Extracts into multiple chunks to allow for parallel processing and merge after processing. Set the default value to Y and use this process configuration group to run the report.

The process configuration enables BIP to split large XML output from Extracts into multiple chunks, allowing for parallel processing and merging after processing.

Note: Although the output for each chunk is merged into a single Excel workbook, the output for each chunk will be in a separate worksheet in that workbook. Although the XML size at which BI Publisher performance begins to improve significantly by this feature can vary between customers due to extraneous factors beyond the control of the report. It's recommended to turn this feature on for report XML sizes greater than 1 GB.