1.3.8.3 Writer
A Writer is a special type of processor used to write out records to a Staged Data table, Data Interface, Reference Data, or Real time consumer (for real time responses). You can select the attributes you choose to write, and map them to attributes with a different name in your Staged Data table, Data Interface, or real time response.
Once data is in a Staged Data table, it may exported to a Data Store, used in another process, or used in a lookup.
Use a Writer or Writers at the end of a process to report on its results, or to return a response to an external system.
For example:
-
From a batch auditing process, you might write out all valid records to one table, and all invalid records to another table.
-
From a batch cleansing process, you might write out the records that you are intending to migrate to a new system into a Staged Data table, and then check, or recheck, that data in other processes before export.
-
From a real time cleansing process, you might use a Writer to issues responses to each incoming record, with various corrections made.
Inputs
Any attributes that you want to write to a Staged Data table, to Reference Data, to a Data Interface, or as a real time response.
Note:
If you are writing to Reference Data, the data that you are writing must conform to any uniqueness constraints defined in the Reference Data set. For example, if generating a Reference Data set with a uniqueness constraint on a lookup column, make sure that the data you write does not have duplicate values in that column. You may need to use the Group and Merge processor before writing the data to ensure that the data will write correctly. For information about configuring Reference Data, see Adding Reference Data. More
Options
Note that unlike most other processors, the Writer does not launch its configuration dialog when it is connected on the Canvas. This is because Writers are often connected to multiple streams. To launch the Writer configuration dialog, double-click on the processor on the Canvas.
Select the Type of target that you want to write to:
-
Staged data, where you want to write to a table in the EDQ repository, or directly to an external Data Store.
-
Data interface, where you want to choose the target of the data in job configuration rather than in the process, using data interface mappings.
-
Reference data, where you want to use the data in the process to write Reference Data that you will then edit in Director and use in other processors.
-
Real time consumer, where you have a configured Real time consumer that will pick up the response messages.
Then, choose which attributes to write, from the selection on the left. Selected attributes for writing appear in the middle pane for mapping to the target. There are two options above the attribute list to show more information - Show Actual Attributes, which will display the actual attribute name where you are using the latest version of an attribute, and Show Data Types, which will display the data types of the attributes.
The Staged Data table or Reference Data you can write to can either be:
-
Created using the New button (this creates a Staged Data table or Reference Data that corresponds to the selected set of attributes; the attributes may be renamed if required)
-
Selected from the drop down of existing Staged Data tables or Reference Data.
Use the Auto button at the bottom of the screen to map all selected attributes directly to a selected Staged Data table or Reference Data.
Use the Clear button to clear all mappings between selected attributes and attributes in the Staged Data table or Reference Data. (Note that the attributes and columns remain until deleted.)
Click and drag attributes in the middle column to reorder them.
It is also possible to edit the definition of the Staged Data table or Reference Data from the Project Browser or by launching the data editor from the Writer Configuration dialog using the Edit button, 
.
Execution
| Execution Mode | Supported |
|---|---|
|
Batch |
Yes |
|
Real time Monitoring |
Yes |
|
Real time Response |
Yes |
Results Browsing
The data written by the Writer can be viewed in the Results Browser.
Example
In this example, a number of invalid records are written to a Staged Data table called Quarantine output:
