4.2 Ingesting Data into Data Foundation Cloud Service for Banking
To create a connector for ingesting data into Data Foundation Cloud Service
for Banking, complete the following steps:
- Navigate to the home page, click Data Services, and then
click Add Connector.The connectors which are defined are listed here.
- From the menu select Connectors if it is not already selected.
- Click Add. The New Connector window is displayed.
- To define a connector, you must have a source with EDD, Catalog Lookup Objects and a target, which is ADI.
- Click the Source button to open the Data Descriptors panel, which will
display all available EDD/ Catalog Lookup Objects defined.
- You can use Search to quickly locate the required CLO (for example, Accounting Entries, Accounting Entries Header, or Catalog Lookup – Left Outer Join).
- Drag and drop the selected EDD/ CLO. The Catalog Lookup Object is added to the canvas and is ready to be mapped.
- Click Target.
- Search for the ADI you are looking for.
- Select the required ADI and drag it on to the canvas and then create catalog lookup, link the input and output nodes.
- To link the nodes, right click on a component and click Link to and select the component you want to link it with. You can also use your mouse to link the nodes. Point your mouse on the white circle of the input node and with your left-mouse button pressed, move the cursor to the white circle on the output node and release the mouse button.
- At any given time, you can right-click a node to either link, delink, remove inlinks/outlinks, or delete a node.
- To edit or view the properties, on the Connector window, click the Next button on the top of the page.
- Under Connector Details, enter the name and description for the connector.
- Under Pre-Load Options, select the truncate option to be
defined in the target.
- Select one of the available truncate options if you want to remove data from the table. Select No, if you do not wish to truncate the table before loading.
The Partial Truncate is enabled and should not be selected.Note:
For multi-target loads, the truncate type must be the same for all targets. However, truncate expression may vary.- Select Full Truncate to fully truncate. Example: To truncate the entire table. Here no expression is required.
- Select Selected Rows to truncate
based on a specified filter expression. Click the edit button next to
Specify filter expression to define the
expression. Example: If you want to remove some rows, use the
Selected Rows option. Specify the filter
condition for the rows to be deleted. Those rows are removed from the
table before load.
- Click Edit to filter the selected rows.
- Select the required entity and click Validate. This validates the expression.
- Click OK after the expressions are selected.
- Under Properties, enter the value in the Target Rejection Threshold field. You can define the value in number or percentage of error records. For more details, see the Using Target Rejection Threshold section.
- Click Save or Save As
Draft.
Note:
If one or more connectors are referring to the same File or EDD, then create a process pipeline to execute the connectors sequentially and they must not be executed in parallel.