Stream allows you to read large files by streaming the data. Three of the Batch OTDs are able to receive streamed data: BatchFTP, BatchLocalFile, and BatchRecord. The prjBatch_Streaming project demonstrates the following:
The File Adapter polls the input directory periodically. When it sees a specified file, it triggers the Collaboration.
The BatchFTP Adapter streams data to the BatchLocalFileAdapter.
The BatchLocalFile Adapter renames the resulting data file and moves the output data to a new location.
The BatchLocalFile streams the new created file to the BatchRecord Adapter.
The BatchRecord Adapter parses the file in the output file and publishes the parsed records to the File Adapter.
The FileAdapter publishes the files to a local directory.
This sample works with an input file of any size. but to see the streaming feature in action, use a larger file.