4.2.1.2 Creating a GoldenGate Stream
Prerequisites:
To create a GoldenGate stream:
- On the Catalog page, click Create New Item.
- Hover the mouse over Stream and select GoldenGate from the submenu.
- On the Type Properties screen, enter the following details:
- Name: Enter a unique name for the stream. This is a mandatory field.
- Display Name: Enter a display name for the stream. If left blank, the Name field value is copied.
- Description
- Tags
- Stream Type: The selected stream is displayed.
- Click Next.
- On the Source Type page, enter the following details:
-
Connection: Select a GG Change Data.
-
Table name: Enter a valid table name that includes the
period (.)
delimiter between the catalog, schema, and table names. For example,test.dbo.table1
- Generate Full Records: Select this option to stream full data record (value of all fields), irrespective of the database transactional changes to a single column, a subset, or all the columns of a row.
- Database Connection: Select a GoldenGate sourced database connection.
- Enable Cache: Select this option to enable caching for GoldenGate Full Records, to enhance its performance.
-
- Click Next.
- On the Shape screen, select one of the methods to define the shape:
-
Infer Shape : Select this option to detect the shape automatically from the input data stream.
-
Select Existing Shape: Select one of the existing shapes from the drop-down list.
-
Manual Shape : Select this option to manually infer the fields from a stream or file. You can also update the datatype of the fields.
Note:
- To retrieve the entire JSON payload, add a new field with path
$
. - To retrieve the content of the array, add a new field with path
$[arrayField]
.
In both the cases, the value returned is Text.
- To retrieve the entire JSON payload, add a new field with path
- From Stream: Select this option to detect the shape based on the table shape selected in the previous screen.
- From File: Select this option to infer the shape from a JSON file. You can also save the auto-detected shape and use it later.
-
- Click Save.
Note:
The difference between a Kafka stream and a GoldenGate stream is that the pipeline constructs, like the Query Group Table, understands the GoldenGate syntax and associates it with the relevant GoldenGate fields.