4.2.1.2 Creating a GoldenGate Stream

To create a GoldenGate stream:

  1. On the Catalog page, click Create New Item.
  2. Hover the mouse over Stream and select GoldenGate from the submenu.
  3. On the Type Properties screen, enter the following details:
    • Name: Enter a unique name for the stream. This is a mandatory field.
    • Display Name: Enter a display name for the stream. If left blank, the Name field value is copied.
    • Description
    • Tags
    • Stream Type: The selected stream is displayed.
  4. Click Next.
  5. On the Source Type page, enter the following details:
    • Connection: Select a GG Change Data.

    • Table name: Enter a valid table name that includes the period (.) delimiter between the catalog, schema, and table names. For example, test.dbo.table1

    • Generate Full Records: Select this option to stream full data record (value of all fields), irrespective of the database transactional changes to a single column, a subset, or all the columns of a row.
      • Database Connection: Select a GoldenGate sourced database connection.
      • Enable Cache: Select this option to enable caching for GoldenGate Full Records, to enhance its performance.
  6. Click Next.
  7. On the Shape screen, select one of the methods to define the shape:
    • Infer Shape : Select this option to detect the shape automatically from the input data stream.

    • Select Existing Shape: Select one of the existing shapes from the drop-down list.

    • Manual Shape : Select this option to manually infer the fields from a stream or file. You can also update the datatype of the fields.

      Note:

      • To retrieve the entire JSON payload, add a new field with path $.
      • To retrieve the content of the array, add a new field with path $[arrayField].

      In both the cases, the value returned is Text.

    • From Stream: Select this option to detect the shape based on the table shape selected in the previous screen.
    • From File: Select this option to infer the shape from a JSON file. You can also save the auto-detected shape and use it later.
  8. Click Save.

Note:

The difference between a Kafka stream and a GoldenGate stream is that the pipeline constructs, like the Query Group Table, understands the GoldenGate syntax and associates it with the relevant GoldenGate fields.