7.1 Uploading Data Files for Ingestion

The file operation process enables you to add files that must be processed to the object store. You can upload any CSV, XLSX, and Text file that you wish to be stored in the object store, which can be processed later.

To upload a file, complete the following steps:

1. On the DFCS home page, click the User Menu and select Administration.
2. Click File Operations.
3. Click Upload File.
   The Generate PAR URL to upload file window is displayed. This is the initial state when a PAR URL is generated. It indicates that the system is ready to receive the file.
4. Enter the File Name.
5. Select the File Type from the drop-down list.
   The supported file types are: CSV, XLSX, Text, and Zip.
6. Enter the file size (in bytes) as seen on the disk.

   Note:

   Enter a number between 0 and 8,053,063,681. The input should be no more than 255 characters. Ensure the value matches the following format: '[a-zA-Z0-9][a-zA-Z0-9.-_:]*[a-zA-Z0-9]'.
7. Click Add to add more files, and repeat the steps.
8. Click Delete to remove files.
9. Click Generate.
   Generating a file upload creates a PAR (Pre-Authenticated Request) URL, valid for 24 hours, which is used to upload the file into the object store. When the PAR URL is generated, the status is set to Uploading. Once the file is uploaded, it is scanned for virus and validated. After successful validation, the status changes to Available, meaning the file is safe and ready for download/processing.

   Note:

   If the same file name is uploaded multiple times, the system will always use the latest uploaded file for processing.
10. An entry for the PAR URL you just created appears on the File Operations page.
    The search feature provides you multiple options to search for a file based on name, creation date, and so on. You can also sort the list by name and creation date in ascending or descending order.

    You can download a file using REST API.