How can I chunk the data of the publication process?

Use the profile options provided for the publication process:

Profile option	Purpose
EGI_PUBLICATION_ITEMS_PER_PAYLOAD	Use this to define the number of items per payload in the publication scheduled process. The predefined value is 500. If a value more than 500 is specified, then 500 is used.
EGI_PUBLICATION_NUMBER_OF_PAYLOADS	Use this to define the number of publication sub processes. This profile option determines the number of parallel payloads to be used in the publication process. The predefined value is 10.
EGI_PUBLICATION_SIZE_OF_ZIP_FILE	Use this to control the overall size of the publication .zip file, in megabytes. The recommended value is 500 MB or lower.

Profile option

Purpose

EGI_PUBLICATION_ITEMS_PER_PAYLOAD

Use this to define the number of items per payload in the publication scheduled process. The predefined value is 500. If a value more than 500 is specified, then 500 is used.

EGI_PUBLICATION_NUMBER_OF_PAYLOADS

Use this to define the number of publication sub processes.

This profile option determines the number of parallel payloads to be used in the publication process. The predefined value is 10.

EGI_PUBLICATION_SIZE_OF_ZIP_FILE

Use this to control the overall size of the publication .zip file, in megabytes. The recommended value is 500 MB or lower.

When deciding the values for these profile options, keep the following in mind:

The capacity of the application you're publishing to.
The equipment specifications for where the publication is running and in the applications you're publishing to.
How often the publication job is run.