7.1 Uploading Data Files for Ingestion

The File Operations process allows users to upload and download files to and from the object store. It provides options to generate Pre-Authenticated Request (PAR) URLs for secure uploads and manage stored files through an easy-to-use interface.

You can upload any CSV, XLSX, and Text file, zip file that you wish to be stored in the object store, which can be processed later.
To upload a file, complete the following steps:
  1. On the DFCS home page, click the User Menu and click Administration.
  2. Click File Operations.
  3. Click Upload File or Generate PAR URL to upload file .
A Pre-Authenticated Request (PAR) URL is used to upload files directly to the object store securely.
  1. Click Generate PAR URL.
  2. In the popup window:
    • Enter the File Name.
    • Select the File Type from the dropdown list.
    • Enter the File Size (in MB).
  3. Click Add to include multiple file details (optional).
  4. Click Generate to create the PAR URLs.
  5. The system will display the generated URLs for use in file uploads. This generates a PAR (pre-authenticated request) URL which is valid for 24 hours. This PAR URL is used to upload the file into the object store.
  6. Enter the File Name.

Upload File

You can upload a file either directly or by using the generated PAR URL.

Steps to Upload a File
  1. Click Upload File.
  2. The Upload popup appears.
  3. Either:
    • Drag and drop the file into the box, or
    • Click to browse and select a file.
  4. Supported file formats: XLSX, CSV, TXT, and ZIP.

    Note:

    Enter a number between 0 and 8,053,063,681. The input should be no more than 255 characters. Ensure the value matches the following format: '[a-zA-Z0-9][a-zA-Z0-9.-_:]*[a-zA-Z0-9]'.
  5. The selected file name appears under Selected file.
  6. Click Upload to begin uploading.
  7. Once uploaded successfully, the file status will be updated in the main table.
After uploading, all available files are listed in the table with the following details:
Column Description
File Type Type of file (e.g., XLSX, CSV, ZIP)
File Name Name of the file stored in the object store
File Size File Size
Created by User who uploaded the file
Last Updated Timestamp of the last modification
Status Indicates whether the file is Uploading, Available, or Failed
Download Provides a link/button to download the file
File Status Flow
  1. Uploading – When a PAR URL is generated and file upload is in progress.
  2. Available – Once the file is successfully uploaded, scanned, and ready for download.
  3. Failed – If upload or validation fails.