Data Intake

The File Receiving System is responsible for parsing the Data Intake file and sending appropriate messages to the JMS queue. A listener in OIPA listens for messages on the queue, and when it receives the process operation message (see Data Intake document on OTN for messaging details), it creates a file resumable task to monitor the status of the file. OIPA also has a record resumable task that controls the processing of the individual records in the file. On receiving the process operation message, the record resumable task creates runnable tasks to process the data intake records. The runnable tasks run on all the nodes of the cycle grid thus distributing the workload for speed of execution. The tasks are managed by Coherence. The file resumable task periodically checks to see the status of record processing and updates the file processing status based on it. Once all the records have been processed, the file is marked as complete.

OIPA Bridge/ListenerSubmit TaskJMS queue File Receiving SystemCycle AgentCycle AgentCycle AgentCycle Agent