Command Line Utility for Partition-Based Derived Entities

The command line utility RefreshPartitions.sh enables the handling of interdependency, performance improvements, executions, rebuilds, and migrations for partition-based Derived Entities.

The utility refreshes partition-based Derived Entities. It does not affect non-partition-based Derived Entities or Derived Entities which have been changed to a partition-based Derived Entities from the backend (without being explicitly resaved post backend metadata seeding). In such cases, the Derived Entities require resave operations before being referenced to the refresh partition utility.

Based on the parameters provided, the utility can add, purge, and refresh partitions for Derived Entities. It can also action the Run filter provided as a parameter. You can specify to add or delete partitions, or do both. The filter condition is not mandatory, however, if input, it gets applied only on addition and refresh of partitions.

The salient features of this command line utility are as follows:
  • Enhanced to rebuild and retain all available partitions along with the history.
  • Provided wrapper-materialized view on pre-built tables, which are based on the configurable through flag.
  • Provided a separate METADATA_PERFORMANCE_PARAMS table at the Derived Entities code level for performance management.
  • Provided a new METADATA_EXECUTION_PARAMS execution table for Derived Entities to register the information for Refresh Partition invocation.
  • Introduced a new METADATA_EXECUTION_LOGS execution logging table for Derived Entities to capture the execution log unifying with the batch Id.

Note:

  • Deleting partitions happens before adding partitions.
  • Existing partitions will continue to exist if they are not mentioned in the parameter list.

Note:

You can run the utility as described in the following subsections by providing the parameters implicitly as part of the execution or use the externalize the runtime parameters method described in the Externalize Dynamic Parameters for Derived Entity Refresh Partition Executions.

The following options are available to run the utility:

  • Run Directly from the Console
  • Run from the Operations Module