4.17.1 Data Quality Check

  • To run the Data Quality (DQ) check, set the following values in the watch list-manage- ment.properties file. This file is located in the <domain_name>/edq/oedq.local.home/ runprofiles/ directory in the WinSCP server.
    • phase.DQ\ -\ Stage\ DJW\ reference\ lists.enabled = Y
    • phase.DQ\ -\ DJW\ reference\ data\ quality\ analysis.enabled = Y
    • stageddata.DQ\ DJW\ -\ Invalid\ Standard\ Country\ in\ DJ\ Country\ to\ Standard\ Country.visible = Y
    • stageddata.DQ\ DJW\ -\ Missing\ Category\ in\ DJW\ SI\ Category.visi- ble = Y
    • stageddata.DQ\ DJW\ -\ Missing\ Category\ in\ DJW\ SI\ Category\ Description.visible = Y
    • stageddata.DQ\ DJW\ -\ Missing\ DJW\ Country\ in\ DJ\ Country\ to\ Standard\ Country.visible = Y
    • stageddata.DQ\ DJW\ -\ Missing\ Name\ in\ DJW\ List\ Provider\ Refer- ence\ Data.visible
    • stageddata.DQ\ DJW\ -\ Missing\ Occupation\ Name\ in\ DJW\ Occupa- tion\ Category.visible
    • stageddata.DQ\ DJW\ -\ Obsolete\ Category\ in\ DJW\ SI\ Category.visible
    • stageddata.DQ\ DJW\ -\ Obsolete\ Category\ in\ DJW\ SI\ Category\ Description.visible
    • stageddata.DQ\ DJW\ -\ Obsolete\ DJW\ Country\ in\ DJW\ Country\ to\ Standard\ Country.visible
    • stageddata.DQ\ DJW\ -\ Obsolete\ Name\ in\ DJW\ List\ Provider\ Ref- erence\ Data.visible
    • stageddata.DQ\ DJW\ -\ Obsolete\ Occupation\ Name\ in\ DJW\ Occupa- tion\ Category.visible
  • To move data from the Windows batch file to the Linux shell script, follow these steps in the watch list-management.properties file:
    • Comment out phase.DJW\ -\ Download.externaltasks.Download\ Dow\ Jones\ Watch list.command = download-djw.bat
    • Uncomment phase.DJW\ -\ Download.externaltasks.Download\ Dow\ Jones\ Watch list.command = download-djw.sh