prjBatch_Streaming

Stream allows you to read large files by streaming the data. Three of the Batch OTDs are able to receive streamed data: BatchFTP, BatchLocalFile, and BatchRecord. The prjBatch_Streaming project demonstrates the following:

• The File Adapter polls the input directory periodically. When it sees a specified file, it triggers the Collaboration.

• The BatchFTP Adapter streams data to the BatchLocalFileAdapter.

• The BatchLocalFile Adapter renames the resulting data file and moves the output data to a new location.

• The BatchLocalFile streams the new created file to the BatchRecord Adapter.

• The BatchRecord Adapter parses the file in the output file and publishes the parsed records to the File Adapter.

• The FileAdapter publishes the files to a local directory.

This sample works with an input file of any size. but to see the streaming feature in action, use a larger file.