1 System Requirements and Preinstallation Instructions

This chapter contains the requirements for the system and database resources that support Oracle GoldenGate.

Topics:

1.1 Overview of Oracle GoldenGate for IBM DB2 for i

With Oracle GoldenGate for IBM DB2 for i, you can replicate data to and from similar or dissimilar supported DB2 for i versions, or you can replicate data between a DB2 for i database and a database of another type. Oracle GoldenGate for DB2 for i supports the filtering, mapping, and transformation of data unless otherwise noted in this documentation.

Oracle GoldenGate for DB2 for i runs directly on a DB2 for i source system to capture data from the transaction journals for replication to a target system. To apply data to a target DB2 for i database, Oracle GoldenGate can run directly on the DB2 for i target system or on a remote Windows or Linux system. If installed on a remote system, Replicat delivers the data by means of an ODBC connection, and no Oracle GoldenGate software is installed on the DB2 for i target.

Note:

The DB2 for i platform uses one or more journals to keep a record of transaction change data. For consistency of terminology in the supporting administrative and reference Oracle GoldenGate documentation, the terms "log" or "transaction log" may be used interchangeably with the term "journal" where the use of the term "journal" is not explicitly required.

1.2 Verifying Certification and System Requirements

Make sure that you are installing your product on a supported hardware or software configuration. For more information, see the certification document for your release on the Oracle Fusion Middleware Supported System Configurations page.

Oracle has tested and verified the performance of your product on all certified systems and environments; whenever new certifications occur, they are added to the proper certification document right away. New certifications can occur at any time, and for this reason the certification documents are kept outside of the documentation libraries and are available on Oracle Technology Network.

1.3 Operating System Requirements

This section outlines the requirements to support Oracle GoldenGate on the local operating system.

1.3.1 General Requirements

  • Portable Application Solution Environment (PASE) must be installed on the system.

  • OpenSSH is recommended to be installed on the system. OpenSSH is part of the IBM Portable Utilities licensed program and allows SSH terminal access to the system in the same manner as other Linux system.

  • The IBM DB2 for i Program temporary fixes (PTFs) that are required by release for Oracle GoldenGate are detailed in the following tables:

    IBM i6.1 Group PTF Level Name Notes

    SF99610

    13058

    Cumulative PTF

    Other required PTF: 5761SS1, SI51061

    Check with command: DSPPTF LICPGM(5761SS1) SELECT(SI51061)

    SF99601

    30

    DB2 for i

    .

    SF99609

    153

    Group HIPER

    .

    SF99354

    15

    TCP/IP

    .

    SF99562

    24

    JAVA

    Java agent requires product 5761JV1 option 12 (Java SE 6 64-bit)

    IBM i7.1 Group PTF Level Name Notes

    SF99710

    15142

    Cumulative PTF

    Other required PTF: 5770SS1, SI51060

    Check with command: DSPPTF LICPGM(5770SS1) SELECT(SI51060)

    SF99707 11 Technology refresh

    .

    SF99701

    26

    DB2 for i

    .

    SF99709

    99

    Group HIPER

    .

    SF99367

    7

    TCP/IP

    .

    SF99572

    12

    JAVA

    Java agent requires product 5761JV1 option 12 (Java SE 6 64-bit)

    IBM i7.2 Group PTF Level Name Notes

    SF99720

    16127

    Cumulative PTF

    Other required PTF: 5761SS1, SI51061Check with command: DSPPTF LICPGM(5761SS1) SELECT(SI51061)

    SF99717

    4

    Technology refresh

    .

    SF99702

    12

    DB2 for i

    .

    SF99719 67 Group HIPER

    .

    SF99767

    2

    TCP/IP

    .

    SF99716

    9

    JAVA

    Java agent requires product 5761JV1 option 12 (Java SE 6 64-bit)

    These required PTFs are the levels at which Oracle GoldenGate has been tested against for the 12c releases. In order to check the group PTF levels, you must use the WRKPTFGRP command from a 5250 terminal session and check for the specific PTFs with the commands shown in the preceding tables. The specific extra PTFs must be at least temporarily applied.

1.3.2 Memory Requirements

The amount of memory that is required for Oracle GoldenGate depends on the amount of data being processed, the number of Oracle GoldenGate processes running, the amount of main storage (RAM, or physical memory) available to Oracle GoldenGate, and the amount of auxiliary storage (disk space, available as shared memory segments) that is available to Oracle GoldenGate for caching transaction data that exceeds available physical memory.

The amount of main storage that is used by Oracle GoldenGate is controlled by the operating system, not the Oracle GoldenGate processes. The Oracle GoldenGate cache manager takes advantage of the memory management functions of the operating system to ensure that the Oracle GoldenGate processes work in a sustained and efficient manner.

On the DB2 for i platform, to provide enough shared memory segments to the Oracle GoldenGate cache manager, the recommended setting for the PASE_MAXSHR64 environment variable is a value of 513 (128GB) or higher. If you use the DB2 for i native Oracle GoldenGate commands, PASE_MAXSHR64 is set to provide 128GB of shared memory segments to the cache manager automatically. If not using the DB2 for i native commands, you can set this environment variable before starting the DB2 for i PASE session. For more information about evaluating Oracle GoldenGate memory requirements, see the CACHEMGR parameter in Reference for Oracle GoldenGate.

Note:

If PASE_MAXSHR64 is not set, you may encounter a warning message stating that the virtual memory is less than the recommended amount. Unless you have very large long-running transactions or a very large number of concurrent transactions, you may ignore this message.

1.3.3 Disk Requirements

This section outlines the disk requirements for Oracle GoldenGate.

  • To determine the size of the Oracle GoldenGate download file, view the Size column before downloading your selected build from Oracle Software Delivery Cloud. The value shown is the size of the files in compressed form. The size of the expanded Oracle GoldenGate installation directory will be significantly larger on disk.

  • Allow sufficient disk space for virtual memory. The default set by the Oracle GoldenGate cache manager is 64 GB on 64-bit systems. See Memory Requirements for additional information about memory management.

  • An additional 1 GB of disk space on any system that hosts Oracle GoldenGate trails, which are files that contain the working data. You may need more or less than this amount, because the space that is consumed by the trails depends on the volume of data that will be processed. See the guidelines for sizing trails in Administering Oracle GoldenGate.

1.3.4 Network Requirements

Oracle GoldenGate requires the following network resources.

  • Configure the system to use TCP/IP services, including DNS. Oracle GoldenGate supports IPv4 and IPv6 and can operate in a system that supports one or both of these protocols.

  • Configure the network with the host names or IP addresses of all systems that will be hosting Oracle GoldenGate processes and to which Oracle GoldenGate will be connecting. Host names are easier to use.

  • Oracle GoldenGate requires some unreserved and unrestricted TCP/IP ports, the number of which depends on the number and types of processes in your configuration. See the Administering Oracle GoldenGate for details on how to configure the Manager process to handle the required ports.

  • Keep a record of the ports that you assigned to Oracle GoldenGate. You will specify them with parameters when configuring the Manager process.

  • Configure your firewalls to accept connections through the Oracle GoldenGate ports.

1.3.5 Oracle GoldenGate Security Privileges

This section outlines the security privileges that Oracle GoldenGate requires on a source DB2 for i system and on a Windows or Linux target system.

1.3.5.1 Oracle GoldenGate Security Privileges on an DB2 for i Source System

The person who installs Oracle GoldenGate must have read and write privileges on the Oracle GoldenGate installation directory, because steps will be performed to create some sub-folders and run some programs. This person also must have authority to the RSTOBJ command, plus the ability to create a library if desired. For ease of installation, it is recommended that the user installing the product has *ALLOBJ authority

On an DB2 for i source system, the Manager and Extract processes are active. The DEFGEN utility also may be active if you are replicating data to a dissimilar target system. On an DB2 for i target system, the Replicat process is active unless you install Replicat on a remote Windows or Linux system. All processes run on both systems in a bidirectional configuration.

The Oracle GoldenGate processes must be assigned a user profile account that is dedicated to Oracle GoldenGate and cannot be used by any other program. One user profile can be used by all of the Oracle GoldenGate processes. This profile need only be granted permission to the objects that Oracle GoldenGate will be operating upon. If specific change data is not to be seen by Oracle GoldenGate, do not include it in any of the journals that the Oracle GoldenGate user profile is allowed to access. All Oracle GoldenGate processes must have privileges to read, write, and delete files and directories within the Oracle GoldenGate installation directory.

The Manager process must have privileges to control all other Oracle GoldenGate processes (DB2 for i *JOBCTL authority).

Assign *USE authority to all objects on the system that the Extract user profile must have access to. Assign *CHANGE authority to all objects on the system that the Replicat user profile must have access to. This can be accomplished by either granting *ALLOBJ authority to the user, or by setting the individual authority to the objects (FILE, LIBRARY and JOURNAL objects) that the user must access. This includes the objects in the QSYS2 library where the SQL catalog resides. These authorities must be granted through the native DB2 for i interface through a 5250 terminal session or through the DB2 for i Operations Navigator product available from IBM.

The Extract and Replicat database user profiles must be specified with the USERID parameter when you configure the parameter files (see Configuring Oracle GoldenGate for DB2 for i) and in the DBLOGIN command prior to issuing any GGSCI commands that interact with the database.

1.3.5.2 Oracle GoldenGate Security Privileges on a Windows or Linux System

The person who installs Oracle GoldenGate must have read and write privileges on the Oracle GoldenGate installation directory, because steps will be performed to create some sub-folders and run some programs. On Windows, the person who installs Oracle GoldenGate must log in as Administrator.

On a Windows or Linux system, Manager, Replicat, and Collector (program name is "server") are active. Manager controls the other processes and interacts with Collector to receive incoming data, while Replicat applies data to the target DB2 for i database through ODBC.

Oracle GoldenGate processes must be assigned a user account that is dedicated to Oracle GoldenGate and cannot be used by any other program. One user account can be used by all of the Oracle GoldenGate processes. This account must have privileges to read, write, and delete files and directories within the Oracle GoldenGate installation directory.

If the Extract user profile does not have the required authority, Extract will log the following errors and stop.

[SC=-1224:SQL1224N A database agent could not be started to service a request, or was terminated as a result of a database system shutdown or a force command.SQL STATE 55032: The CONNECT statement is invalid, because the database manager was stopped after this application was started]

The user profile must be specified with the USERID parameter when you configure the parameter files (see Configuring Oracle GoldenGate for DB2 for i) and in the DBLOGIN command prior to issuing any GGSCI commands that interact with the database.

1.4 Supported DB2 for i Data Types

Oracle GoldenGate supports all DB2 for i data types, except those listed in Non-Supported DB2 for i Data Types.

Limitations of support

Extract fully supports the capture and apply of TIMESTAMP(0) through TIMESTAMP(6). Extract also captures TIMESTAMP(7) through TIMESTAMP(12), but it truncates the data to microseconds (maximum of six digits of fractional time) and issues a warning to the error log. Replicat truncates timestamp data from other sources to microseconds when applying it to TIMESTAMP(7) through TIMESTAMP(12) in a DB2 for i target.

Oracle GoldenGate supports timestamp data from 0001/01/03:00:00:00.000000 to 9999/12/31:23:59:59.999999. If a timestamp is converted from GMT to local time, these limits also apply to the resulting timestamp. Depending on the time zone, conversion may add or subtract hours, which can cause the timestamp to exceed the lower or upper supported limit.

1.5 Non-Supported DB2 for i Data Types

Oracle GoldenGate does not support the following IBM for i data types.

  • XML

  • DATALINK

  • DECFLOAT

  • User-defined types

1.6 Supported Objects and Operations for DB2 for i

Oracle GoldenGate supports the following DB2 for i objects and operations.

  • Extraction and replication of DML operations .

  • Tables with the maximum row length supported by the database.

  • Tables that contain up to the maximum number of columns that is supported by the database, up to the maximum supported column size.

  • DELETE FROM with no WHERE clause SQL statements and Clear Physical File Member (CLRPFM)

  • Base tables underlying Materialized Query Tables, but not the MQTs themselves. The target database automatically maintains the content of the MQT based on the changes that are applied to the base tables by Replicat.

  • Both Library (Native) names including members, and SQL names are allowed.

  • Partitioned tables

  • Limitations on Automatic Heartbeat Table support are as follows:

    • The ADD HEARTBEATTABLE command creates a new file called ogghbfreq¿ in the Oracle GoldenGate build folder. Do not delete this file because the pase heartbeat program reads the frequency values from it.

    • There is an extra executable in the Oracle GoldenGate build folder named ogghb.

    • An extra process named ogghb starts running from the time the ADD HEARTBEATTABLE command is given and runs until you disable the heartbeat with the DELETE HEARTBEATTABLE command. This process automatically restarts even if it is killed. To remove this process from the system, use the DELETE HEARTBEATTABLE command.

    • When using the ALTER HEARTBEATTABLE command to change the heartbeat frequency with the PURGE_FREQUENCY or RETENTION_TIME options, it takes approximately 60 + older 'frequency') seconds to be implemented.

    • There is an initial delay of 30 seconds between ADD HEARTBEATTABLE and the first record is updated in the heartbeat seed table.

1.7 Non-Supported Objects and Operations for DB2 for i

Oracle GoldenGate does not support the following objects or operations for DB2 for i.

  • DDL operations

  • Schema, table or column names that have trailing spaces.

  • Multiple instances of a database

  • The Multi-Journal feature does not support multi-journal sync of a transaction across multiple journals.

1.8 Oracle GoldenGate Parameters Not Supported for DB2 for i

This section lists some of the Oracle GoldenGate configuration parameters that are not supported for the DB2 for i platform. For full descriptions of Oracle GoldenGate parameters and the databases they support, see Oracle GoldenGate Parameters.

  • BATCHSQL (not supported on V5R4 and i6.1 only)
  • BR
  • ASCIITOEBCDIC and EBCDICTOASCII
  • BINARYCHARS
  • LOBMEMORY
  • TRAILCHARSETEBCDIC
  • Any encryption options that use AES encryption

1.9 Supported Object Naming Conventions

Oracle GoldenGate supports SQL naming conventions and also supports native file system names in the format of library/file(member).

For native (system) names, Oracle GoldenGate supports the normal DB2 for i naming rules for wildcarding, which allows *ALL or a partial name with a trailing asterisk (*) wildcard. For example:

  • library/*all(*all)

  • library/a*(a*)

  • library/abcde*

Oracle GoldenGate does not allow wildcarding for library names.

The member name is optional and may be left off. In that case, data for all of the members will be extracted, but only the library and file names will be captured and included in the records that are written to the trail. The result is that the data will appear to have come from only one member on the source, and you should be aware that this could cause integrity conflicts on the target if there are duplicate keys across members. To include the member name in the trail records, include the member explicitly or though a wildcarded member specification.

For SQL names, only the first member in the underlying native file is extracted in accordance with the normal operation of SQL on an DB2 for i system. For SQL names, Oracle GoldenGate supports the wildcarding of table names, but not schema names. For instructions on wildcarding SQL names, see Administering Oracle GoldenGate.

1.10 Supported Character Sets

The default behavior of a DB2 for I Extract is to convert all character data to Unicode. The overhead of the performance of the conversion to UTF-8 for the text data has been substantially reduced. However, if you want to send data in its native character set you can use the CHARSET and COLCHARSET parameters to override the default behavior as follows. See CHARSET and COLCHARSET in Reference for Oracle GoldenGate

When COLCHARSET PASSTHRU is provided for a particular column, that column is not converted into Unicode, and its source character set is provided in the trail metadata, so that Replicat can correctly process the trail data in the native character set of the column improving performance on the source side. To enable the trail to contain multiple character sets, the columns should be configured in PASSTRHU mode. For example:

TABLE GGSCHEMA.TABLE1, CHARSET(PASSTHRU);  
TABLE GGSCHEMA.TABLE2, COLCHARSET(PASSTHRU, COL1, COL2, COL3);

Where COL1, COL2, COL3 are CHAR or VARCHAR fields with a valid CCSID.

For a CCSID 65535 character field (equivalent to a BINARY or CHAR FOR BIT DATA field), you can specify a column character set override with the valid character set of the column. The field will no longer been seen as a binary field by the Oracle GoldenGate processes and is seen as a normal character field. The data is converted to UTF8, and you cannot use the PASSTHRU capability if a COLCHARSET is specified to provide a specific character encoding for a binary field. The conversion to UTF-8 makes it possible for this type of override to be compatible with HP NonStop or any other platform that requires essentially ASCII compatible data from the source. The default behavior for a CCSID 65535 CHAR or VARCHAR field is not to convert the field and bind it as binary. For example:
TABLE GGSCHEMA.TABLE3, COLCHARSET(IBM037, COL1, COL2);

Where COL1 and COL2 are CHAR or VARCHAR fields with CCSID 65535.

You can set a column character override for any CHAR, CLOB, or VARCHAR column with a valid character set (not CCSID 655350 when the data contained in the column has a different character set than what you intended. For example, if there is a CHAR column with CCSID set as 1047, and the data contained in it is actually in CCSID 37, you can set a column override CCSID for the column in the Extract or DEFGEN parameter file so that when it processed, the processes recognize that the data is actually in CCSID 37 and not in CCSID 1047. The data is treated as CCSID 37, but converted to UTF8.

You cannot override the CHARSET and use PASSTHRU together. For example:

TABLE GGSCHEMA.TABLE4, COLCHARSET(IBM037, COL1);

Where COL1 is a CHAR or VARCHAR field defined with CCSID 1047 and the data is actually in CCSID 37.

If the column character set of a source column is not a valid character set supported by Oracle GoldenGate ICU and you specify COLCHAR SETPASSTHRU in the Extract or DEFGEN parameter file, then the PASSTHRU behavior is ignored, and the column data is converted to Unicode. This ensures that the data is convertible on the Replicat. Since the data has no ICU representation, there is no way to indicate what character set the data is really in.