Enable Targeted Collections of Source Data by Organization Groups in Parallel for External Systems
You can now use parallel data collection architecture for the Oracle Fusion Cloud Supply Chain Planning collection processes. This update adds two capabilities to accelerate and scale Oracle Supply Chain Planning collections. You can use organization groups for targeted refresh for reference, supply, and demand planning entities. And you can use aggregated staged-data loads, which let you split large volumes across multiple compressed files.
This feature allows you to:
- Collect reference and demand planning entities with targeted refresh by organization group to Oracle Supply Chain Planning using file-based data import (FBDI).
- Retain collected data for organizations that aren’t included in the organization group when doing targeted collections using the Load Planning Data from Flat Files scheduled process.
- Collect high-volume entities via FBDI by loading multiple 1 GB files per entity under a common staged data group and then pulling the total contents of the files into Plan Inputs. This circumvents the 1 GB file size limit imposed by Oracle Universal Content Management. You don’t need to collect by organization group to take advantage of this capability.
Targeted Refresh with Organization Group Using Load Planning Data from Flat Files
Prior to this feature, you could already use FBDI to collect demand and supply entities relevant for Oracle Supply Chain Planning using a targeted refresh with the organization group. This feature adds support for reference and demand planning entities. The following tables list the complete set of supply planning, demand planning, and reference entities now supported by this mode of collections.
Supply Planning Entities
Following are the list of supply planning entities supported for organization group with targeted and net change refresh.
| Entity Name | Template Name | FBDI Template CSV Name |
|---|---|---|
| Reservations* | ScpReservationImportTemplate.xlsm | Reservation.csv |
| Work Order By Product Supplies* | ScpWorkOrderSuppliesImportTemplate.xlsm | WorkOrderSupplies.csv |
| Work Order Operation Resource* | ScpWIPOperationResourceImportTemplate.xlsm | WIPOperationResource.csv |
| Movement Requests | ScpMovementRequestsImportTemplate.xlsm | MovementRequests.csv |
| Demand Forecasts** | ScpExternalForecastImportTemplate.xlsm | ExternalForecast.csv |
| Order Promising Supply Updates | ScpRealTimeSupplyUpdatesImportTemplate.xlsm | RealTimeSupplyUpdates.csv |
| Planned Order Supply** | ScpPlannedOrderSupplyImportTemplate.xlsm | PlannedOrderSupply.csv |
| Intransits* | ScpPurchaseOrderRequisitionImportTemplate.xlsm | PurchaseOrderRequisition.csv |
| On hand* | ScpOnhandImportTemplate.xlsm | SupplyOnhand.csv |
| Purchase Order in Receiving* | ScpPurchaseOrderRequisitionImportTemplate.xlsm | PurchaseOrderRequisition.csv |
| Purchase Requisitions* | ScpPurchaseOrderRequisitionImportTemplate.xlsm | PurchaseOrderRequisition.csv |
| Work Order Supplies* | ScpWorkOrderSuppliesImportTemplate.xlsm | WorkOrderSupplies.csv |
| Purchase Orders* | ScpPurchaseOrderRequisitionImportTemplate.xlsm | PurchaseOrderRequisition.csv |
| Work Order Component Demands* | ScpWIPComponentDemandsImportTemplate.xlsm | WIPComponentDemands.csv |
| Safety Stock** | ScpSafetyStockLevelImportTemplate.xlsm | SafetyStockLevel.csv |
| Sales Orders* | ScpSalesOrderImportTemplate.xlsm | SalesOrder.csv |
| Transfer Orders* | ScpTransferOrderImportTemplate.xlsm | TransferOrder.csv |
All entities are supported for external source systems.
*These entities are supported for Oracle Fusion Cloud SCM with FBDI when Enable External Data Source is selected in the Manage Planning Source System task for the Oracle Fusion Cloud SCM source system.
**These entities are supported for Oracle Fusion Cloud SCM and external source systems.
Demand Planning Entities
Following are the list of demand planning entities supported for an organization group with targeted and net change refresh.
| Entity Name | Template Name | FBDI Template CSV Name |
|---|---|---|
| Forecast Measures | ScpForecastMeasureImportTemplate.xlsm | DPForecasts.csv |
| Measures | ScpMeasuresImportTemplate.xlsm | Measures.csv |
| Option Booking History | ScpOptionBookingHistoryImportTemplate.xlsm | OptionBookingHistory.csv |
| Option Shipment History | ScpOptionShipmentHistoryImportTemplate.xlsm | OptionShipmentHistory.csv |
| Price Lists | ScpPriceListImportTemplate.xlsm | PriceList.csv |
| Bookings History | ScpBookingHistoryImportTemplate.xlsm | BookingHistory.csv |
| Shipments History | ScpShipmentHistoryImportTemplate.xlsm | ShipmentHistory.csv |
All entities are supported for Oracle Fusion Cloud SCM and external source systems.
Reference Entities
Following are the list of reference entities supported for an organization group with targeted and net change refresh.
| Entity Name | Template Name | FBDI Template CSV Name |
|---|---|---|
| Routing Operation Outputs* | ScpRoutingsImportTemplate.xlsm | RoutingOperationOutputs.csv |
| Item Subinventories | ScpItemSubinventoryImportTemplate.xlsm | ItemSubinventories.csv |
| Item Policies | ScpItemPolicyOverridesImportTemplate.xlsm | ItemPolicyOverrides.csv |
| Bill of Resource | ScpBillOfResourcesImportTemplate.xlsm | BillOfResources.csv |
| Item Cost | ScpItemCostImportTemplate.xlsm | ItemCost.csv |
| Routing* | ScpRoutingsImportTemplate.xlsm | Routings.csv |
| Item Category Assignments | ScpCatalogImportTemplate.xlsm | ItemCategories.csv |
| Routing Operations* | ScpRoutingsImportTemplate.xlsm | RoutingOperations.csv |
| Organizations | ScpOrganizationImportTemplate.xlsm | Organization.csv |
| Organization Sites | ScpOrganizationImportTemplate.xlsm | OrganizationSite.csv |
| Resources* | ScpResourcesImportTemplate.xlsm | WorkCenterResources.csv |
| Resource Availability* | ScpResourceAvailabilityImportTemplate.xlsm | ResourceAvailability.csv |
| Subinventories | ScpSubInventoryImportTemplate.xlsm | SubInventory.csv |
| BOM Component Substitutes* | ScpBillofMaterialImportTemplate.xlsm | BOMComponentSubstitutes.csv |
| Routing Operation Resources* | ScpRoutingsImportTemplate.xlsm | RoutingOperationResources.csv |
| Resource Shifts | ScpResourcesImportTemplate.xlsm | ResourceShifts.csv |
| Bills of Materials* | ScpBillofMaterialImportTemplate.xlsm | BillofMaterials.csv |
| Bill of Resource Alternate Resources | ScpBillOfResourcesImportTemplate.xlsm | BORAlternateResources.csv |
| Bill of Resource Component Substitutes | ScpBillOfResourcesImportTemplate.xlsm | BORComponentSubstitutes.csv |
| Bill of Resource Option Dependent | ScpBillOfResourcesImportTemplate.xlsm | BOROptionDependent.csv |
| Purchase Order Receipt History | ScpPurchaseOrderRcvHistoryImportTemplate.xlsm | PurchaseOrderRcvHistory.csv |
| Items | ScpItemImportTemplate.xlsm | Item.csv |
| Bill of Material Components* | ScpBillofMaterialImportTemplate.xlsm | BillofMaterialComponents.csv |
All entities are supported for external source systems.
*These entities are supported for Oracle Fusion Cloud SCM with FBDI when Enable External Data Source is selected in the Manage Planning Source Systems task for the Oracle Fusion Cloud SCM source system.
How To Collect Entities
To collect entities using an organization group with targeted refresh:
- Group organizations within a source system to an organization group using the Manage Organization Groups action in the Maintain Supply Network Model task.
- Organizations in a source system can be associated to only one group. Based on the selection of the source system in Load Planning Data from Files, the relevant organization groups for the source system will be available for selection.
- Prepare CSV files for the entities to be collected.
- Submit the Load Planning Data from Flat Files collection process:
a. Select Targeted for collection type.
b. Select Yes for the Enable Organization Group Collection parameter.
c. Select the organization group from the list of values for the Organization Group parameter.
Additional Details for Targeted Refresh with Organization Group Using Load Planning Data from Flat Files
- Collections loads data with targeted refresh only for the organizations selected in the organization group. Existing data for these reference and demand planning entities for other organizations are retained even with targeted refresh.
- Supported for Oracle Cloud SCM and external source organizations.
- Supported when Load Planning Data from Flat Files is invoked from Enterprise Resource Planning integration service.
- Supported when Load Planning Data from Files is submitted as a scheduled process from the Scheduled Processes user interface or by using a scheduled process job set or REST services.
Collect High-Volume Entities with Targeted Refresh Using Load Planning Data from Flat Files
Currently, we recommend that a data file size shouldn’t exceed 1 GB to collect data using Load Planning Data from Flat Files. This means that you can only run net change collections for subsequent collections to collect entities greater than 1 GB. This feature provides you with the capability to collect entities with a large volume using targeted refresh with Load Planning Data from Flat Files.
- Supported for Oracle Cloud SCM and external source organizations
- Supported when Load Planning Data from Flat Files is invoked from Enterprise Resource Planning integration service
- Supported when Load Planning Data from Files is submitted as a scheduled process from the Scheduled Processes user interface or by using a scheduled process job set or REST services
Load Planning Data from Flat Files has been enhanced with new parameters: Collect Earlier Staged Data and Staged Data Group.
Collect Earlier Staged Data
- Valid values are No, Yes, no selection.
- No – Collects the data from data files and populates staging tables with a Staged Data Group reference indicating that all the data in multiple zip files belong to same group. This is an intermediate step where the data isn’t yet collected to Plan Inputs.
- Yes – Collects the data from the data file with the reference of the Staged Data Group, and also loads the data for all the previously staged data for this group to Plan Inputs. All of the Staged Data Group’s data will be collected and available in Plan Inputs.
- When there is no selection, aggregated staged data with targeted refresh isn’t supported.
Staged Data Group
- Valid values are no selection, or values displayed from the Group Code for Collections Staged Data lookup. The list of values displays the meanings of the selectable lookup values. The values can be numeric or alphanumeric. You can either create your own lookup values based on business requirement or use the predefined lookup values.
To create a Staged Data Group lookup value:
- Go to Navigator > My Enterprise > Setup and Maintenance.
- Search for and select the Manage Standard Lookups task.
- In the Meaning field, enter Group Code for Collections Staged Data, and then click Search.
- Click the + icon.
- Enter values for the fields: Lookup Code, Display Sequence, Start Date, Meaning, and Description.
- Select the Enabled checkbox to enable the lookup code.
- Click Save.
To collect aggregated staged data with targeted refresh using Load Planning Data from Flat Files:
- Prepare the CSV files and split the overall data into multiple data zip files with the size of each file not exceeding 1 GB.
- Create a staged data group reference in the Group Code for Collections Staged Data lookup to represent the set of Load Planning Data from Flat Files for the same set of zip files.
- Launch Load Planning Data from Flat Files with targeted refresh to load multiple data files by setting Collect Earlier Staged Data to No and selecting the same lookup value for Staged Data Group. You can optionally select Organization group. This will collect all the data from multiple Load Planning Data from Flat files to staging tables with the same staged data group reference.
- Next, Launch Load Planning Data from Flat Files to load multiple data files by setting Collect Earlier Staged Data to Yes and selecting the same lookup value for Staged Data Group. This will now load all the data with same staged data group reference to Oracle Supply Chain Planning, and data will be visible in Plan Inputs. Select the same organization group that was selected in step 3.
Example of Aggregated Staged Data Group and Organization Group Collections with Targeted Refresh
The following image shows an example of how you might split an overall data file to collect data for a data zip file size of 4 GB for the organization group APAC region.
| Load Planning Data from Flat File - collection run | Overall organization group data file Size | Data file size for collection run | Organization Group | Collect Earlier Staged Data | Staged Data Group | Explanation |
|---|---|---|---|---|---|---|
| 1 |
4GB |
1GB | APAC Region | No | 1 | Collects data for organizations in APAC Region organization group from run 1 data file to staging tables with staged data group reference as 1 |
| 2 | 1GB | Collects data for organizations in APAC Region organization group from run 2 data file to staging tables with staged data group reference as 1 | ||||
| 3 | 1GB | Collects data for organizations in APAC Region organization group from run 3 data file to staging tables with staged data group reference as 1 | ||||
| 4 | 1GB | Yes | Collects data for organizations in APAC Region organization group from run 4 data file to staging tables with staged data group reference as 1. Loads data from runs 1,2,3 and 4 for organizations in APAC region with staged data group reference 1 to Supply Chain Planning Cloud |
Steps to enable and configure
Use the Opt In UI to enable this feature. For instructions, refer to the Optional Uptake of New Features section of this document.
Offering: Supply Chain Planning
Tips and considerations
- If you want to use the Enable Targeted Collections of Source Data by Organization Groups in Parallel for External Systems feature, then you must opt in to its parent feature: Replenishment Planning. If you’ve already opted in to this parent feature, then you don’t have to opt in again
- If global entities and entities that aren’t supported with organization group collections are included in the data file, the collection process ignores those entities.
- Create trees for dimension isn’t generated for Load Planning Data from Flat files when the Collect Earlier Staged Data parameter is set to No.
- Collections submitted without a staged data group number won’t collect the staged data group to Oracle Supply Chain Planning.
Access requirements
Users who are assigned a configured job role that contains these privileges can access this feature:
- Monitor Supply Planning Work Area (MSC_MONITOR_SUPPLY_PLANNING_WORK_AREA_PRIV)
- Monitor Demand and Supply Planning Work Area (MSC_MONITOR_DEMAND_AND_SUPPLY_PLANNING_WORK_AREA_PRIV)
- Manage Replenishment Planning (MSC_MONITOR_REPLENISHMENT_PLANNING_WORK_AREA_PRIV)
- Manage Sales and Operations Planning (MSC_MONITOR_SALES_AND_OPERATIONS_PLANNING_WORK_AREA_PRIV)
- Monitor Backlog Management Work Area (MSC_MONITOR_BACKLOG_MANAGEMENT_WORK_AREA_PRIV)
- Monitor Order Promising Work Area (MSC_MONITOR_ORDER_PROMISING_WORK_AREA_PRIV)
These privileges were available prior to this update.