7.1.4.1 Add Task to a Batch or Batch Group
- Click Define Tasks from the Header panel.The Define Task window is displayed.
- Select the Batch or Batch Group for which you want to add new task from the Select drop-down list.
- Click Add.The Create a New Task window is displayed.When creating a task, there are multiple types of components to choose from:Model
- Model: Select the Model of selected Objective. It can be any specific model of Objective or All models of Objective. If the ALL_CHAMPION is selected here, then Objectives with no Champion Model is skipped, and the Objectives with Champion Models gets executed. If CHAMPION is selected, and no Champion is present, then Model Execution gets fail.
- Objective: Select the Object which you want to use for execution. For more information, see the Create Objective (Folders) section. The Sub Objective is displayed with path. For example, if Test1 is Objective and Test11 is Sub Objective, and you want to use Test11 Objective for execution, then select this field as Test1/Test11.
- Link Types: You can set this parameter to Yes or No. If Synchronous Execution is set to Yes, then execution will wait for the notebook execution status. If Synchronous Execution is set to No, then execution will not wait for the notebook execution status, it will trigger the notebook and update task status as successful in batch monitor.
- Synchronous Executions: You can set this parameter to Yes or No. If Synchronous Execution is set to Yes, then execution will wait for the notebook execution status. If Synchronous Execution is set to No, then execution will not wait for the notebook execution status, it will trigger the notebook and update task status as successful in batch monitor.
- Optional Parameters: This is used pass the parameters dynamically.
Populate Workspace- Global Filter: Provided input will be applied as a data filter on all the tables selected for data sourcing.
- Table Filter: Users can provide data filters individually on the tables here. Please note that you may provide multiple table names for the same SQL filter. Global Filters will not be applicable for those tables on which filters have been applied individually. In case the same table name is provided in more than one rows here, the filter condition will be generated as a conjunction of all the provided filters.
- Additional Parameters: Additional parameters include source/target pre-scripts, fetch size, and commit size to optimize data processing and control execution behavior.
- Enter the details as given here:
Table 7-2 Fields in the Create a New Task window and their Description
Field Description Task Name Enter the task name. NOTE:
- The Task Name must be alphanumeric and should not start with a number.
- The Task Name should not exceed 60 characters in length.
- The Task Name should not contain any special characters except underscore (_).
Task Description - Enter the task description along with spaces and alpha-numeric. No special characters are allowed in Task Description.
- Words like Select From or Delete From should not be entered in the Description.
Task Type Select the task type from the drop-down list: Rest: Used to invoke RESTful APIs. Only POST method is supported commonly used to trigger downstream services (For example: models, graphs and so on) or workflows.
Executable: Used to run shell scripts (.sh) or other system-level executables.
Batch Service URL Select the required Batch Service URL from the drop-down list. This can be blank, and you can provide the full URL in the Task Service URL field.
WORKSPACE_URL: Seeded batch URL base endpoint of the batch service responsible for managing and orchestrating batch or batch group executions related to workspace APIs.
MMG_SERVICE_URL: Seeded batch URL base endpoint of the batch service responsible for managing and orchestrating batch or batch group executions related to MMG APIs (For example: Model Execution).
CS_SERVICE_URL: Seeded batch URL base endpoint of the batch service responsible for managing and orchestrating Batch or Batch Group executions related to CS APIs.
Component These are preceded metadata types, which can be executed through Scheduler. The user is allowed to select the required components with regards to the select Bacth URL, or the user can create their own CUSTOM URLs by selecting the CUSTOM component. Task Service URL Enter task service URL if it is different from Batch or Batch Group Service URL. Batch URL: This is the base endpoint of the batch service responsible for managing and orchestrating batch or batch group executions. Users can append the task end points in the Define Task. There is nothing as Batch group service URL.
Task Service URL: This is the endpoint for executing individual tasks (For example, REST calls). Users can either provide an end point path to be appended to the Batch URL provided in the batch definition or specify a full REST URL for independent execution.
- From the Task Parameters pane, click Add to add a new
Task Parameter. By default, all Batch level parameters are added and enabled as
task parameters. To disable, deselect the check box corresponding to the task
parameter ( )
- Enter the Parameter name in the Param Name field.
- Enter the Parameter value in the Param
Value field.
You can delete a parameter by clicking Delete corresponding to the parameter.
- Click Save.
Note:
Header Parameter: This parameters are passed in the request header of the execution API to provide metadata like workspace, service ID and so on.