6 Batch - Data Archive

The purpose of data archive is to archive and truncate purge history tables regularly in SIOCS.For selected history tables, before data is purged from transaction tables, the data will be archived by inserting into archive tables. The Data archive involves two steps: Archive Data and Export Data Dump Files

Archive Data

1. Generate data dump files: The archive data pump process will create data dump files from *_ARV tables if last exported archive date is X number of days in the past (The X number of days is default to 180 days, it is configurable in EICS system configuration screen with minimum value to 180 days).

2. Truncate Archive Tables: Once the archived data is dumped to a file, the corresponding archive tables will be truncated.

3. Record Last export date: Update the last exported date by archive groups in ARCHIVE_ACTIVITY

Export Data Dump Files

The archive purged data history data dump files will be collected from database directory and export to retailer by cloud engineer (for example, via sFTP).

Once the data dump files are exported, it is up to retailer to take the files, SIOCS will no longer keep the data dump files.

Note: The data dump file location in database server can be queried using following: Login to SIOCS PDB: SELECT DIRECTORY_PATH FROM DBA_DIRECTORIES WHERE DIRECTORY_NAME = 'SIOCS_DATA_PUMP_DIR';

Archive Batch Summary

Table 6-1 Archive Batch Summary

Program	Description
Audits_ArchiveJob (Archive Activity Job)	Archive activity data into activity archive tables.
ItemUinHistory_ArchiveJob (Archive Item UIN History Job)	Archive item UIN data into item UIN archive tables.
StoreItemStockHistory_ArchiveJob (Archive Store Item Stock History Job)	Archive store item stock history data into store item stock history archive tables.
ArchiveDump_OpsJob (Archive Dump Job)	Export archive history data into Dump files and truncate archive history tables.

Audits_ArchiveJob (Archive Activity Job)

Module Name	Audits_ArchiveJob
Description	Archive activity data into activity archive tables.
Module Type	Admin
Runtime Parameters	N/A

Key Tables

Table 6-2 Key Tables for Audits_ArchiveJob Batch

Table	Select	insert	Update	Delete
ACTIVITY_HISTORY	X			X
ARV_ACTIVITY_HIST		X

Scheduling Consideration

Table 6-3 Scheduling Consideration for Audits_ArchiveJob

Schedule Information	Description
Frequency	Daily
Scheduling Consideration	Run before Archive_Dump Batch
Pre-processing	N/A
Post-processing	N/A
Threading	N/A

ItemUinHistory_ArchiveJob (Archive Item UIN History Job)

Module Name	ItemUinHistory_ArchiveJob
Description	Archive item UIN data into item UIN archive tables.
Module Type	Admin
Runtime Parameters	N/A

Key Tables

Table 6-4 Key Tables for ItemUinHistory_ArchiveJob

Table	Select	insert	Update	Delete
ITEM_UIN_HISTORY	X			X
ARV_ITEM_UIN_HIST		X

Scheduling Consideration

Table 6-5 Scheduling Consideration for ItemUinHistory_ArchiveJob

Schedule Information	Description
Frequency	Daily
Scheduling Consideration	Run before ArchiveDump_OpsJob (Archive Dump Job)
Pre-processing	N/A
Post-processing	N/A
Threading

StoreItemStockHistory_ArchiveJob (Archive Store Item Stock History Job)

Module Name	StoreItemStockHistory_ArchiveJob
Description	Archive store item stock history data into store item stock history archive tables.
Module Type	Admin
Runtime Parameters	N/A

Key Tables

Table 6-6 Key Tables for StoreItemStockHistory_ArchiveJob

Table	Select	insert	Update	Delete
STORE_ITEM_STOCK_HISTORY	X			X
ARV_STORE_ITEM_STOCK_HIST		X

Scheduling Consideration

Table 6-7 Scheduling Considerations for StoreItemStockHistory_ArchiveJob

Schedule Information	Description
Frequency	Daily
Scheduling Consideration	Run before ArchiveDump_OpsJob (Archive Dump Job)
Pre-processing	N/A
Post-processing	N/A
Threading

ArchiveDump_OpsJob (Archive Dump Job)

Module Name	ArchiveDump_OpsJob
Description	Export archive history data into Dump files and truncate archive history tables.
Module Type	Admin
Runtime Parameters	N/A

Key Tables

Table 6-8 Key Tables for ArchiveDump_Ops.bb

Table	Select	insert	Update	Delete
ARV_ACTIVITY_HIST	X			X
ARV_ITEM_UIN_HIST	X			X
ARV_STORE_ITEM_STOCK_HIST	X			X
ARV_EXPORT		X	X

Scheduling Consideration

Table 6-9 Scheduling Considerations for ArchiveDump_Ops.bb

Schedule Information	Description
Frequency	Daily
Scheduling Consideration	Run after archive jobs
Pre-processing	N/A
Post-processing	N/A
Threading	Oracle Data Pump Controlled