1.6.3.1.2 Creating and Executing a Custom DQ Run Pipeline
- Click the + icon in the Process Modeler
Summary page.
Table 1-21 Process Details
Field Description Process ID The Process ID is automatically generated and unique for each process. This ID identifies the specific process within the system. Process Name Enter the name of the process. This will help users identify the process within the application. Process Description Provide a brief description of what this process does, to give context and help other users understand its purpose. App Package ID The App Package ID refers to the identifier for the application package that contains the process. In this case, it is set to "FSDF Components." Registered Topics This field allows the selection or listing of topics that are registered in the system. Topics could refer to areas of data or categories the pipeline will work with. Spark DB The Spark DB option indicates whether or not the process is using Apache Spark for database operations. Here, it is set to "No," meaning Spark is not being used. Tag This is an optional field where tags can be added for better categorization or to facilitate searching for this process in the future. Service ID_Workspace This shows the Service ID_Workspace associated with the process. The service is identified as Oracle Financial Services Data Service for Analytics, which suggests this process is related to data services for financial analytics. - Click the check mark icon to save the entered
details.The Process Flow canvas is displayed.
- By default, the START activity appears on the canvas indicating the beginning of the process.
- Drag and drop the RUN DQ Rule process widget.
- To connect one component with an other, right-click the source component and choose Start Link. Next, click on the destination component and click End Link. Alternatively, if you drag and drop a component on another component on the canvas, the two components will be linked.
- Proceed to link all the components per your requirement.
- Double click the RUN DQ Rule process widget to enter the details. For more information on the parameters, see RUN DQ RULE section.
- Click Save.
- Execute the Custom DQ Run Pipeline. For more details on how to execute a pipeline, see Run Pipeline.