Data file writing components rotate log files to indicate that they are no longer writing new information in a file and that it is ready to be processed by the data warehouse loader server. When a data file writing component rotates a log file, it does the following:
It opens a new log file that will hold any new data that the component collects. It stops writing any data in the old log file.
It invokes a log rotation message source component to send a Java Messaging System (JMS) message. The JMS message indicates that the data in the old log file is ready to be loaded into the data warehouse database.
A log rotation sink component receives the JMS message and adds the closed log file and its type to the queue in the
DataWarehouseLoaderRepository. The data warehouse loader server components will load the data in a separate server process.
Configure the data file writing component to send log rotation messages with the following properties.
messageSource- the Nucleus path of the log rotation message source componentlogRotationMessageType- the Java class of the JMS messages handled by the data file writing component
Data file writing components rotate log files when one of two conditions occurs. These are:
The schedule configured by the
scheduleandschedulerproperties prompts the component to rotate the log file.The number of records in the log file exceeds the maximum number allowed by the
dataItemThresholdproperty.
Log files are rotated by the FileLogger components, either at a scheduled time or when a configured limit on the number of log entries is reached.
Note: If a log file does not contain any data, the data file writing component will not rotate it.
