DATE RANGE

The DATE_RANGE parameter will override the start and end filters of the ObjectStorageFileSearchDataSource and SaveMetricOutputAsJsonPostProcessor present in the application configuration.

In case of Partition Data based on Date Time supported format, one needs to include a specific data source in the application config for the baseline reader or prediction reader using ObjectStorageFileSearchDataSource and must have partition_based_date_range.

For Example: In below image the input data is stored in object storage bucket in partition date folder format.

"CONFIG_LOCATION": "<HTTP_LOCATION_OF_OCI_STORAGE_APPLICATION_CONFIG_FILE_PATH>"
"RUNTIME_PARAMETER": "{"ACTION_TYPE":"RUN_BASELINE", "DATE_RANGE":{"start":"2023-06-28", "end":"2023-06-29"}}"

As shown below same configuration is also applicable for the prediction_reader similar to baseline_reader

The partition data which needs to be filtered for the baseline run or prediction run evaluation must follow the below structure with start and end dates mentioned in the filter_args parameters.

  "baseline_reader": {
  "type": "CSVDaskDataReader",
  "params": {
    "data_source": {
      "type": "ObjectStorageFileSearchDataSource",
      "params": {
        "file_path": [
          "oci://<bucket_name>@<namespace>/<object_prefix>/dataset.csv"
        ],
        "filter_arg": [
          {
            "partition_based_date_range": {
              "start": "2023-06-26",
              "end": "2023-06-27",
              "data_format": ".d{4}-d{2}-d{2}."
            }
          }
        ]
      }
    }
  }
}

In case of Partition Data based on Date Time supported format, one needs to include a specific data source in the application config for the post processor using SaveMetricOutputAsJsonPostProcessor and must have date_range param defined.

"post_processors": [
  {
    "type": "SaveMetricOutputAsJsonPostProcessor",
    "params": {
      "file_name": "profile.json",
      "file_location_expression": "profile-$start_$end.json",
      "date_range": {
        "start": "2023-08-01",
        "end": "2023-08-05"
      },
      "can_override_profile_json": false,
      "namespace": "<NAMESPACE>",
      "bucket_name": "<BUCKET_NAME>"
    }
  }
]