1. Data Loading Guide
  2. About Data Loading
  3. Users

Users

In OFS FCCM Cloud Service, Administrators prepare, load, and process data into the staging tables.

Prerequisites for Users

Administrators who will load data into FCCM Cloud Service applications must meet the following pre-requisites:
  • Must have knowledge of Extract, Transform, and Load (ETL) process to prepare data in the .csv format.
  • Must have knowledge of an HTTP utility such as cURL.
  • Must be mapped to the Application Administrator group (SCHEDULERADMINGRP) if intended to execute the data processing jobs from the application.
Before you start a using data loading service, you must understand the following concepts and terminologies:
  • Data File: This service expects data in a specific template in the .csv format. If the size of the file exceeds 100MiB, then it is recommended to split the files. This assists you to upload data swiftly into Object Storage. Furthermore, the data loading service expects the files to follow a particular naming convention. For more information on the naming convention of files, file split, tables, and templates, see Preparing Data.
  • Object Storage: The OFS FCCM Cloud Service uses Oracle Object Storage to store the .csv files. A PAR URL helps you to access Object Storage. Every Object Storage has buckets and they are containers for storing objects in a compartment within an Object Storage. For example, Standard Storage Bucket and Archive Storage Bucket. The maximum size for an uploaded object is 10 TiB. Object parts must be no larger than 50 GiB.
  • Standard Storage Bucket: The standard storage bucket is used to move and access data daily. This bucket is configured to store data for seven days. After seven days, the data files are archived into an Archive Storage Bucket.
  • Archive Storage Bucket: The Archive storage bucket is used to access data rarely. Data files in this bucket are retained for one year. After one year, the archived data files are auto deleted from this bucket.
  • Objects: All data, regardless of the content type are stored as objects in the Object Storage. For example, log files, .csv files, and so on.
  • Bucket: A bucket is a logical container that stores objects. Buckets can serve as a grouping mechanism to store related objects together.
  • Pre-authenticated requests: A pre-authenticated (PAR) URL request allows you to access Object Storage. Using this PAR URL you can upload data into the Object Storage using the standard HTTP utility like cURL. The PAR URL is refreshed after every seven days. For more information, see Uploading Data Files.
  • cURL: A standard HTTP utility used to transfer data using URLs.
  • Staging Tables: These tables contain business data such as transaction, account, customer details. Staging is the process of preparing business data taken from the business applications before moving into the processing layer.
  • Scheduler Service: A service that assists to define jobs for tasks to execute on a scheduled time and date by running the batches/jobs. This service also helps to monitor the jobs. For more information, see Loading Data Files.
  • Batch processing: A mechanism to associate related jobs/ tasks in a group or batch in the Scheduler Service.