D.4 Pre-processing & Loading Directory Structure
Data for Pre-processing and Loading are organized in subdirectories below the ingestion_manager root level.
The following figure illustrates the subdirectories that the
ingestion_manager directory contains.
Figure D-1 Pre-processing & Loading Directory Structure
The following table lists these important subdirectories that compose the
<OFSAAI Installed Directory>/ingestion_manager directory
structure.
Table D-10 Data Management Directory Structure Description
| Directory Name | Description |
|---|---|
| data/backup | Contains backup files for the various Data Management components. |
| data/errors | Contains error files for various Data Management components. |
| data/firm | Contains Oracle client data files that Data Management components write. |
| inbox | Contains data files that the Oracle client provides. |
| jars | Contains the Java Archive (JAR) files to run Java Data Management components implemented in Java. |
| config | Contains files used to configure the Data Management components (see for more information). |
| logs | Contains log files that Data Management components write. |
| scripts | Contains all the shell scripts for running Data Management components. |
| /inbox/<yyyymmdd> | Backup of input files (for restart purposes, if necessary). |
| /data/<firm or market>/ load |
|
| /logs/<yyyymmdd> | Pre-processing and load status, and error messages. |
| /data/errors/<yyyymmdd> | Records that failed validation. The file names are the same as those of the input files. |
| /data/firm/transform | TC trading data files that the FDT processes. |
These directories are further explained in the following sections: