D.4.4.3 data/firm Subdirectory

The firm subdirectory within the data subdirectory contains the extract, transform and load subdirectories that correspond directly to the workflow steps that Firm data moves through during Data Management.

The following sections describe each subdirectory.

extract Subdirectory

The extract subdirectory within the firm subdirectory contains checkpoint data and working files for each Pre-processor during Pre-processing.

Each Pre-processor also maintains checkpoint files that enable it to recover after a failure and without the loss of data integrity; an FDT removes the files after it successfully Pre-processes its data. When finished, each Pre-processor moves its final Pre-processed files to either the transform subdirectory for processing by FDT, or to the load subdirectory for loading into the database.

The.XDP file type identifies files that the Pre-processor creates.

transform Subdirectory

The transform subdirectory within the firm subdirectory contains the FDT’s checkpoint data and working files during transformation. When finished, the FDT moves its final transformed Firm data files to the load subdirectories for loading into the database. The system writes the transformed data to files and then moves the files to the load subdirectory. The.FDT file type identifies the files that the FDT creates.

The FDT also maintains several checkpoint files that allow it to recover after a failure, without the loss of data integrity.

load Subdirectory

The load subdirectory within the firm subdirectory contains additional subdirectories that contain Pre-processed and transformed Firm data that the system queues for loading into the database. Each loader component monitors its respective subdirectory (that is, data queue) looking for data to load into the database—a subdirectory exists for each kind of Oracle client data that processing loads into the database. After loading data files into the database, each loader moves the processed files to the backup subdirectory.