D.4.3.2 Data Ingest XML Configuration File
The following table describes the parameters for the DataIngest.xml configuration file.
Note:
Default values for properties in this file are suitable for most deployments. Use caution when changing any default values.Table D-14 Data Ingest Properties
| Type | Property Name | Description | Example |
|---|---|---|---|
| ProcessingBatch: Specifies batch settings that override settings in the database. Overrides are primarily useful during testing. | ProcessingBatch.Name | Sets the current batch name. Ingestion components process only input files that contain this value in the batch name portion of the file name. This property should be blank during normal operation. | |
| ProcessingBatch: Specifies batch settings that override settings in the database. Overrides are primarily useful during testing. | ProcessingBatch.Date | Sets the current processing date. Ingestion components process only input files that contain this value in the processing date portion of the file name. This property should be blank during normal operation. The date format is YYYYMMDD. | |
| ProcessingBatch: Specifies batch settings that override settings in the database. Overrides are primarily useful during testing. | ProcessingBatch.Last | Identifies the flag that indicates processing of the last batch of the day to Data Management. This property should be blank during normal operation. | |
| Miscellaneous | DefaultSourceSystem.value | Indicates the default value to use for source system when manufacturing reference data records. | MTS |
| Miscellaneous | BufferSize.value | Specifies the buffer size in kilobytes for I/O byte buffers that
the MDS and FDT processes create to read input files.
Use care when changing this parameter due to impact on performance and memory requirements. |
1024 |
| Miscellaneous | DirectBufferSize.value | Specifies the buffer size in kilobytes for Java NIO direct byte
buffers that the MDS, MDT, and FDT processes create to read input
files.
Use care when changing this parameter due to impact on performance and memory requirements |
1024 |
| Miscellaneous | DefaultCurrency.value | Indicates the value to use as the issuing currency when manufacturing security records from order or trade execution records. | USD |
| Miscellaneous | UseDirectBuffers.value | Specifies whether to make use of Java NIO’s direct buffer mechanism. | TRUE |
| Miscellaneous | Separator.value | Specifies the delimiter that separates fields in data file records. | ~ |
| Log: Specifies properties used to configure the common logging module. | Log.UseDefaultLog | Specifies whether the system uses the default log file for a component. The default log file has the name of the component and resides in a date subdirectory of the logs directory (in YYYYMMDD format). | TRUE |
| Log: Specifies properties used to configure the common logging module. | Log.UseDateLog | Specifies whether to put default log file for a component in a
date subdirectory.
Otherwise, it is placed directly under the logs directory. |
TRUE |
| Log: Specifies properties used to configure the common logging module. | Log.InitDir | Specifies the location of the properties file for configuring the common logging module (install.cfg). | ../config |
| DB: Specifies properties related to database access. | DB.Connection.Driver | Indicates the JDBC driver class name. | oracle.jdbc.driver.Orac leDriver |
| DB: Specifies properties related to database access. | DB.Connection.InitialConnect ions | Specifies the number of connections initially to allocate in the connection pool. | 1 |
| DB: Specifies properties related to database access. | DB.Connection.MaximumConnect ions | Indicates the maximum number of connections in the connection pool. You should correlate this parameter to the number of configured threads for the component. | 10 |
| DB: Specifies properties related to database access. | DB.Connection.Timeout | Identifies the number of seconds to wait before timing out on a database connection attempt. | 10 |
| DB: Specifies properties related to database access. | DB.Connection.NumRetries | Specifies the maximum number of times to attempt to connect to a database before failing. | 5 |
| BUSINESS: Specifies properties related to data loaded into the ATOMIC schema. | BUSINESS.ExtractDir | Identifies the parent directory for intermediate files that Pre-processors produce that are applicable to the ATOMIC schema in the database. | ../data/firm/extract |
| BUSINESS: Specifies properties related to data loaded into the ATOMIC schema. | BUSINESS.TransformDir | Specifies the working directory for the FDT component which transforms BUSINESS trade-related data. | ../data/firm/transform |
| BUSINESS: Specifies properties related to data loaded into the ATOMIC schema. | BUSINESS.LoadDir | Indicates the parent directory for directories that store ATOMIC schema bound data files prior to loading with the Java data loader component. Control files for native loaders also reside below this directory. | ../data/firm/load |
| MANTAS: Specifies properties related to data loaded into the ATOMIC schema. | MANTAS.ExtractDir | Specifies the parent directory for intermediate files that Pre-processors produce that are applicable to the ATOMIC schema in the database. | ../data/mantas/extract |
| MANTAS: Specifies properties related to data loaded into the ATOMIC schema. | MANTAS.TransformDir | Specifies the working directory for intermediate files that utilities produce that are applicable to the ATOMIC schema in the database. | ../data/mantas/ transform |
| MANTAS: Specifies properties related to data loaded into the ATOMIC schema. | MANTAS.LoadDir | Specifies the parent directory for directories that store ATOMIC schema bound data files prior to loading with the Java data loader component. Control files for native loaders also reside below this directory. | ../data/mantas/load |
| Directory: Specifies properties used to define directory locations. | Directory.Log | Specifies the parent directory for log file directories and log files that Java ingestion components create. | ../logs |
| Directory: Specifies properties used to define directory locations. | Directory.Inbox | Specifies the input directory where Java ingestion components find files that the Oracle client submits. Processing creates subdirectories in the /inboxdirectory for each day of data, to contain a copy of the input data file. | ../inbox |
| Directory: Specifies properties used to define directory locations. | Directory.Error | Specifies the parent directory for error directories that contain error data files that Java ingestion components create. Each error data file contains records that were not processed due to error. | ../data/errors |
| Directory: Specifies properties used to define directory locations. | Directory.Archive | Specifiesthe parent directory for directories that contain backup copies of intermediate files that Java ingestion components create. | ../data/backup |
| Directory: Specifies properties used to define directory locations. | Directory.Config | Specifies the directory containing configuration files for Java ingestion server. | ../config |
| Directory: Specifies properties used to define directory locations. | Directory.FuzzyMatcher | Specifies the directory containing files related to fuzzy matcher. | ../fuzzy_match |
| Directory: Specifies properties used to define directory locations. | Directory.DataMap | Specifies the directory that contains XML data map files. | ../config/datamaps |
| FileExtension: Specifies properties used to define extensions for various types of files. | FileExtension.Log | Specifies the file name extension for log files. | .log |
| FileExtension: Specifies properties used to define extensions for various types of files. | FileExtension.Checkpoint | Specifies the file name extension for checkpoint files. Many of the Java ingestion components create checkpoint files as an aid to recovery when restarted after exiting prematurely. | .cp |
| FileExtension: Specifies properties used to define extensions for various types of files. | FileExtension.Temporary | Specifies the file name extension for temporary files that Java ingestion components create. | .tmp |
| FileExtension: Specifies properties used to define extensions for various types of files. | FileExtension.Error | Specifies the file name extension for error files that Java ingestion components create. | .err |
| FileExtension: Specifies properties used to define extensions for various types of files. | FileExtension.Data | Specifies the file name extension for input data files that the Oracle client submits. The default value of .datis in accordance with the DIS. | .dat |
| Security: Specifies properties used to produce security reference data. | Security.AdditionalColumns | Specifies additional columns of data that ingestion components must populate when manufacturing security records. | SCRTY_SHRT_NM, SCRTY_ISIN_ID, PROD_CTGRY_CD, PROD_TYPE_CD, PROD_SUB_TYPE_CD |
| Symbol: Specifies properties used for looking up security reference data by security short name. | Symbol.DbTableName | Specifies the name of the database table to use when looking up security records by security short name. | SCRTY |
| Symbol: Specifies properties used for looking up security reference data by security short name. | Symbol.KeyColumn | Specifies the column name to use when looking up security records by security short name. | SCRTY_SHRT_NM |
| Symbol: Specifies properties used for looking up security reference data by security short name. | Symbol.ValueColumn | Specifies the column to use for retrieving the Behavior Detection assigned identifier for a security. | SCRTY_INTRL_ID |
| Symbol: Specifies properties used for looking up security reference data by security short name. | Symbol.Category | Specifies the category of data for the security table. The category is a key for mapping to the database schema in which the security table resides. | BUSINESS |
| SecurityISIN: Specifies properties used for looking up security ISINs. | SecurityISIN.DbTableName |
Specifies the name of the table to use when looking up a security using the Behavior Detection assigned security identifier. |
SCRTY |
| SecurityISIN: Specifies properties used for looking up security ISINs. | SecurityISIN.KeyColumn | Specifies the column name to use when looking up security records by Behavior Detection assigned security identifier. | SCRTY_INTRL_ID |
| SecurityISIN: Specifies properties used for looking up security ISINs. | SecurityISIN.ValueColumn | Specifies the column to retrieve when looking up a security using the Behavior Detection assigned security identifier. | SCRTY_ISIN_ID |
| SecurityISIN: Specifies properties used for looking up security ISINs. | SecurityISIN.Category | Specifies the category of data in which the security table resides. The category is a key for mapping to the database schema in which the security table resides. | BUSINESS |
| FDT: Specifies properties used to configure the FDT component. | FDT.NumberOfThreads.Value | Specifies the number of worker threads that the FDT uses when processing data. | 4 |
| FDT: Specifies properties used to configure the FDT component. | FDT.LowerDisplayLimit.Value | Specifies the quantity below which orders are exempt from display. | 100 |
| FDT: Specifies properties used to configure the FDT component. | FDT.UpperDisplayLimit.Value | Specifies the quantity above which orders are exempt from display. | 10000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.OrderPriceLimit.Value | Specifies the dollar value above which orders are exempt from display. | 200000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.SequenceBatchSize.OrderEvent | Specifies the batch size when retrieving sequence IDs for OrderEvent records (during end-of-day processing). | 1000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.SequenceBatchSize.Order | Specifies the batch size when retrieving sequence IDs for Order records. | 10000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.SequenceBatchSize.Trade | Specifies the batch size when retrieving sequence IDs for Trade records. | 10000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.SequenceBatchSize.Execution | Specifies the batch size when retrieving sequence IDs for Execution records. | 10000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.SequenceBatchSize.DerivedTrad e | Specifies the batch size when retrieving sequence IDs for DerivedTrade records. | 10000 |
| FDT: Specifies properties used to configure the FDT component. | FDT.MarketDataSource.Value | Specifies the source of market data. Valid values are File for file based access or RMI for access using an RMI server (not recommended for performance reasons). | File |
| FDT: Specifies properties used to configure the FDT component. | FDT.CalculateDisplayability.Value | Specifies whether to calculate displayability states. | FALSE |
| FDT: Specifies properties used to configure the FDT component. | FDT.ExplainableCancelCodes.Value | Specifies a comma-separated list of explainable cancellation codes. | |
| FDT: Specifies properties used to configure the FDT component. | FDT.BufferSize.value | Allows an override to the BufferSize.value property for FDT. | |
| FDT: Specifies properties used to configure the FDT component. | FDT.LookForFutureEventTimes. value | ||
| FDT: Specifies properties used to configure the FDT component. | FDT.UsePrevailingSale.value | Specifies whether to use the prevailing reported market sales price as an execution’s expected print price when no comparable market sales occur during the order’s marketable periods. | FALSE |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the expected print price for executions. A reported market sale is comparable to an execution when its size is in the same tier. | FDT.ExecutionSizeThresholds. FirstTierMax | Specifies the maximum size for the first tier. | 1000 |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the expected print price for executions. A reported market sale is comparable to an execution when its size is in the same tier. | FDT.ExecutionSizeThresholds. SecondTierMax | Specifies the maximum size for the second tier. | 5000 |
| FDT: Specifies properties used to configure the FDT component.Data Management uses these parameters when calculating the expected print price for executions. A reported market sale is comparable to an execution when its size is in the same tier. | FDT.ExecutionSizeThresholds. ThirdTierMax | Specifies the maximum size for the third tier. Any size bigger than this value is considered part of the fourth tier. | 10000 |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the marketable time with reasonable size attributes for an order. Processing divides orders into small, medium, and large based on their remaining unit quantities. | FDT.OrderSizeMarketability. MaxSmallSize | Specifies the maximum size for an order to be considered small. | 1000 |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the marketable time with reasonable size attributes for an order. Processing divides orders into small, medium, and large based on their remaining unit quantities. | FDT.OrderSizeMarketability. MaxMediumSize | Specifies the maximum size for an order to be considered medium. | 5000 |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the marketable time with reasonable size attributes for an order. Processing divides orders into small, medium, and large based on their remaining unit quantities. | FDT.OrderSizeMarketability.S mallMinPercentAtBest | Specifies the minimum percent of a small order’s remaining unit
quantity that must be available at the best price for execution to
be considered reasonable.
The minimum percentage value must be represented in its decimal equivalent (for example 1.0 = 100%). |
1.0 |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the marketable time with reasonable size attributes for an order. Processing divides orders into small, medium, and large based on their remaining unit quantities. | FDT.OrderSizeMarketability.M ediumMinPercentAtBest | Specifies the minimum percent of a medium order’s remaining unit
quantity that must be available at the best price for execution to
be considered reasonable.
The minimum percentage value must be represented in its decimal equivalent (for example 1.0 = 100%). |
1.0 |
| FDT: Specifies properties used to configure the FDT component. Data Management uses these parameters when calculating the marketable time with reasonable size attributes for an order. Processing divides orders into small, medium, and large based on their remaining unit quantities. | FDT.OrderSizeMarketability.L argeMinPercentAtBest | Specifies the minimum percent of a large order’s remaining unit
quantity that must be available at the best price for execution to
be considered reasonable.
The minimum percentage value must be represented in its decimal equivalent (for example 1.0 = 100%). |
1.0 |
| FDT: Specifies properties used to configure the FDT component. | FDT.TradePurposeFilter.value | Specifies a comma-separated list of trade purpose codes. Processing does not consider trades with one of these purpose codes in firm reference price derivations. | IFADM, OFEA, CONB, CLNT, BTBX |
| FDT: Specifies properties used to configure the FDT component. | FDT.RunBatchesSeparately.val ue | Specifies whether the FDT treats batches as distinct from one
another.
TRUE: Three defined batches originate from different geographical areas in which the data in each batch does not overlap (that is, an execution in batch A does not occur against an order in batch B). FALSE: Processing does not separate data in each batch into a distinct time interval (that is, an event in batch A occurred at 10am and an event in batch B occurred at 9am, and batch B arrived after batch A). |
TRUE |
| FDT: Specifies properties used to configure the FDT component. | FDT.RegNMSExceptionCodes | Identifies the Order Handling Codes that should be considered as Reg NMS executions. | ISO, BAP, BRD, BOP, SOE, SHE |
| FDT: Specifies properties used to configure the FDT component. | FDT.TreatLostEventsAsErrors. value | Identifies whether lost events found by the FDT (see Rejection During the Transformation Stage, for a discussion of lost events) should be treated as errors (TRUE) or as lost events to be read in on the next run of FDT (false). | TRUE |
| FDT: Specifies properties used to configure the FDT component. | FDT.OpenOrderFileExpected.value | Identifies whether an OpenOrder file will be provided by the client during an end of day batch (TRUE) or whether it will not be provided (FALSE). | TRUE |
| FDT: Specifies properties used to configure the FDT component. | FDT.NonExecutionTradePurpose Codes.value | Specifies a comma-separated list of trade purpose codes. For Trade Execution records that refer to an Order and have one of these codes, the FDT will create a Trade record rather than an Execution record. | CLNT, BTBX |
| FDT: Specifies properties used to configure the FDT component. | FDT.EnableMIFID.value | Identifies whether MiFid related data will be provided (TRUE) or not (FALSE). | FALSE |
| FDT: Specifies properties used to configure the FDT component. | FDT.IgnoreFutureMarketRefs.value | Identifies whether the FDT will use Reported Market Sales records that occur later in time than a given trade when calculating the market reference price for that trade (FALSE) or not (TRUE). | FALSE |
| FDT: Specifies properties used to configure the FDT component. | FDT.MaxFutureMarketRefCompTi me.value |
Specifies the number of seconds from the time a trade occurs during which any reported sales records cannot have the same price and quantity as the given trade to be considered as a market reference price. -1 means that this condition will not apply, 0 means the condition applies to reported sales with the same time, 5 means the condition applies to reported sales within 5 seconds of the trade, and so on. This parameter is only used if FDT.IgnoreFutureMarketRefs.value= FALSE. |
-1 |
| FDT: Specifies properties used to configure the FDT component. The next four parameters are used to generate records in the TRADE_TRXN_CORRECTION table, which record when a correction to a field of an execution, trade, or order occurs. The fields to be checked for corrections should be specified in a comma separated list of business field names. Business field names can be found in the corresponding XML data map file in the datamaps directory | FDT.DeriveCorrectionFields.T rade | Specifies which fields of a trade are monitored for corrections. | UnitQuantity, PriceIssuing |
| FDT: Specifies properties used to configure the FDT component. The next four parameters are used to generate records in the TRADE_TRXN_CORRECTION table, which record when a correction to a field of an execution, trade, or order occurs. The fields to be checked for corrections should be specified in a comma separated list of business field names. Business field names can be found in the corresponding XML data map file in the datamaps directory | FDT.DeriveCorrectionFields.E xecution | Specifies which fields of an execution are monitored for corrections. | UnitQuantity, PriceIssuing |
| FDT: Specifies properties used to configure the FDT component. The next four parameters are used to generate records in the TRADE_TRXN_CORRECTION table, which record when a correction to a field of an execution, trade, or order occurs. The fields to be checked for corrections should be specified in a comma separated list of business field names. Business field names can be found in the corresponding XML data map file in the datamaps directory | FDT.DeriveCorrectionFields.D erivedTrade | Specifies which fields of a derived trade are monitored for corrections. | YieldPercentage, YieldMethodCode |
| FDT: Specifies properties used to configure the FDT component. The next four parameters are used to generate records in the TRADE_TRXN_CORRECTION table, which record when a correction to a field of an execution, trade, or order occurs. The fields to be checked for corrections should be specified in a comma separated list of business field names. Business field names can be found in the corresponding XML data map file in the datamaps directory | FDT.DeriveCorrectionFields.O rder | Specifies which fields of an order are monitored for corrections. | LimitPriceIssuing, UnitQuantity |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.ArchiveFlag | Specifies whether to archive data files. The system copies input files to the backup directory (TRUE) or deletes input files (FALSE). | TRUE |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.ErrorLimit | Specifies the percentage of invalid records to allow before
exiting with an error.
For example, a value of 10 allows 10 percent of records to be invalid before exiting with an error. A value of 0 allows no invalid records. A value of 100 allows all invalid records. |
100 |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.TargetDir | Specifies the directory in which to place the resulting output file. If this is blank (the default), output files reside in the corresponding load directory (a subdirectory of market/load or firm/ loaddepending on the schema of the data being processed). | |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.SequenceBatchSiz e | Specifies the batch size when retrieving sequence IDs. | 100000 |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.AdditionalOutput | Specifies a directory to contain the output file in addition to the target directory. | |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.DoFileLookups | Specifies whether to do reference data lookups for fields that arrive as part of an input file (TRUE) or not do them (FALSE). | FALSE |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.DiscardLookupFai lures | Specifies whether to discard records that fail a reference data lookup (TRUE) or just log a message (FALSE). | FALSE |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.ValidatorClass | Specifies the Java class used to validate records of a given data type. Use of subclasses occurs when the general functionality of AbstractValidator is not enough for a given data type. | AbstractValidator |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.AdapterClass | Specifies the Java class used to process records of a given data type. Use of subclasses occurs when the general functionality of BaseFileAdapter is not enough for a given data type. | BaseFileAdapter |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.NumberOfThreads | Specifies the number of worker threads to be used when Pre-processing a file | 2 |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.BufferSize | Allows an override to the BufferSize.valueproperty for the XDP. | 100 |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.InputFileCharset | Specifies the character set of the DIS input files provided by the client. Currently, the only supported character sets are those that are compatible with ASCII. | UTF8 |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Default.SupplementalType | Specifies an additional file type that a given XDP will create when it processes a file of the given type. | TrustedPairMember |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.Account.DeriveAccountToP eerGroup | When processing Account records, specifies whether to derive an AccountToPeerGroup record if the AccountPeerGroupIdentifier field is populated. | |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.EmployeeTradingRestricti on.DescendOrgTree | If an Employee Trading Restriction record contains an
Organization Identifier, then it specifies:
|
FALSE |
| XDP: Specifies properties used to configure the Pre-processor (XDP) component. | XDP.<Data Type>.<Property> | Overrides the given property for the given Pre-processor instance. | |
| XDL: Specifies properties used to configure the Data Loader (XDL) component. | XDL.Default.FullRefresh | Is valid for data types that have a load operation of Overwrite as defined in the DIS. This parameter specifies replacement of the entire table (TRUE) or provision of deltas (FALSE). | TRUE |
| XDL: Specifies properties used to configure the Data Loader (XDL) component. | XDL.Default.DataFileExts | Specifies the possible file extensions for an input file. | .XDP, .FDT, .MDT, .XDT |
| XDL: Specifies properties used to configure the Data Loader (XDL) component. | XDL.Default.CommitSize | Specifies the number of records to update or insert before committing (not used when Direct=TRUE). | 500 |
| XDL: Specifies properties used to configure the Data Loader (XDL) component. | XDL.Default.ErrorLimit | Specifies the number of rejected records to allow before exiting with an error. If left blank (the default), processing sets no limit. | |
| XDL: Specifies properties used to configure the Data Loader (XDL) component. | XDL.Default.DbErrorCodes | Specifies a comma-separated list of database vendor-specific error codes that indicate data level errors , such as data type and referential integrity. This results in rejection of records with a warning instead of a fatal failure. |
1, 1400, 1401, 1407, 1438, 1722, 1840,1841 2291, 2359, 1839,1847,12899 |
| These properties apply only to the Oracle adapter. | XDL.Default.MaxBindSize | Specifies the maximum number of bytes (integer) to use in the bind array for loading data into the database. | 4194304 |
| These properties apply only to the Oracle adapter. | XDL.Default.Direct | Specifies whether to use direct path loading (TRUE) or conventional path loading (FALSE). | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.Parallel | Specifies whether a direct path load will be donein parallel (TRUE). This will be the case when multiple loaders for the same data type are run in parallel, such as with multiple ingestion instances. | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.Unrecoverable | Specifies whether a direct path load does not use redo logs (TRUE) or uses redo logs (FALSE). | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.Partitioned | Specifies whether a direct path load uses the current date partition (TRUE) or any partition (FALSE). | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.SkipIndexes | Specifies whether a direct path load skips index maintenance (TRUE) or maintains indexes (FALSE). If set to TRUE, rebuilding of indexes must occur after running the Data Loader. | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.SkipIndexErrorCo de | Specifies a database vendor specific error code that occurs in the log file when skipping indexes. | 26025 |
| These properties apply only to the Oracle adapter. | XDL.Default.IndexParallelLev el | Specifies the parallel level of an index rebuild (that is, number ofconcurrent threads for rebuilding an index). | 4 |
| These properties apply only to the Oracle adapter. | XDL.Default.DoAnalyze | Specifies whether to run a stored procedure to analyze a database table after loading data into it. | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.DoImportStatisti cs | Specifies whether to run a stored procedure to import statistics for a database table after loading data into it. | FALSE |
| These properties apply only to the Oracle adapter. | XDL.Default.ImportStatistics Type | Specifies the type of statistic import to perform if DoImportStatistics has a value of True. | DLY_POST_LOAD |
| These properties apply only to the Oracle adapter. | XDL.Default. ImportStatisticsLogDir | Saves the directory to which the stored procedure writes the log file if DoImportStatistics has a value of True. This log directory must reside on the server that hosts the database. | /tmp |
| These properties apply only to the Oracle adapter. | XDL.Default.TableDoesNotExis tErrorCode | Specifies the database error code that indicates a database table does not exist. | 942 |
| These properties apply only to the Oracle adapter. | XDL.Default.UseUpdateLoader | Specifies whether JDBC updates should be used instead of a delete/insert when updating a database record. This is only valid for data types that have a load operation of Update. | FALSE |
| These properties apply only to the Oracle adapter. | XDL.<Data Type>.<Property> | Overrides the specified property for a given Data Loader instance. | |
| IMC: Specifies properties for configuring the Directory Cleanup (IMC) component. | Directory[1..N].Name | Identifies the directory to clean up. The system removes date subdirectories (in YYYYMMDD format) from this directory. | ../data/backup |
| IMC: Specifies properties for configuring the Directory Cleanup (IMC) component. | Directory[1..N].DaysToKeep | Specifies the number of days to keep for this directory. The system does not delete date subdirectories with the latest dates. | 3 |
|
DBUtility: Specifies properties used to configure various utility processes. Valid utility names are SecurityFirmDaily, AccountChangeLogSummary, CustomerChangeLogSummary, AccountToCustomerChangeLogSummary. |
<UtilityName>.NumberofThread s | Specifiesthe number of worker threads that the give component uses when processing data. | 4 |
|
DBUtility: Specifies properties used to configure various utility processes. Valid utility names are SecurityFirmDaily, AccountChangeLogSummary, CustomerChangeLogSummary, AccountToCustomerChangeLogSummary. |
<UtilityName>.SequenceBatchs ize | Specifies the batch size when retrieving sequence IDs for records generated by given component. | 10000 |
| Watch List Service: Specifies properties used to configure the Scan Watch List Web Service. | Timeout.value | Specifies how many seconds a call to the Watch List Service made through the scanWatchList.shscript will wait for the service request to finish. This value should be set to the longest wait time expected based on the volume of data and system configuration. Setting it very high will not affect performance since the call will return as soon as it is complete. | 600 |
| Watch List Service: Specifies properties used to configure the Scan Watch List Web Service. | Log.UseDateLog | Overrides the default Log.UseDateLog property. | FALSE |
| Watch List Service: Specifies properties used to configure the Scan Watch List Web Service. | WatchListScannerClass.value | Identifies the Java class used to scan a watch list for a given name. | MantasWatchListScanner |
| Watch List Service: Specifies properties used to configure the Scan Watch List Web Service. | NameMatcherClass.value | Identifies the Java class used to match a name against a list of names. | FuzzyNameMatcher |
| Watch List Service: Specifies properties used to configure the Scan Watch List Web Service. | FuzzyMatcher.SecondToPoll | Identifies the number of seconds to wait between querying the WATCH_LIST table for new names that are added by the Watch List Management Utility. | |
| Watch List Service: Specifies properties used to configure the Scan Watch List Web Service. | FuzzyMatcher.MaximumAddedNames | Identifies the maximum number of names that can be added to the Watch List Service after it is initialized. If additional names must be added, the service must be re- initialized. |