Bugs Fixed and Enhancements

3 Bugs Fixed and Enhancements

This chapter describes the bugs fixed and enhancements at the time of release.

The Bug number is the number of the BugDB ticket. For questions on specific tickets or issues, consult Oracle Support.

3.1 Release 19.1.0.0.17 — January 2024

Spring Framework Upgrade to at least 6.0.8, 5.3.27, or 5.2.24 to address security vulnerabilty

The following security vulnerability has been fixed: CVE-2023-20863.

Oracle recommends that you upgrade to this patch to include these security fixes.

3.2 Release 19.1.0.0.16 — November 2023

Bug 35617764 - Memory leak in Oracle GoldenGate for Big Data Replicat processes

This issue has been fixed.

Bug 35617691 - Mongo replicat is crashing while processing 3-part table name

This issue has been fixed.

3.3 Release 19.1.0.0.15 — June 2023

Bug 32862043 - Extract is abending with "OGG-25119 Failed to create missing sub-directories"

This issue has been fixed.

3.4 Release 19.1.0.0.14 — June 2022

Bug 34014027 - File Writer Handler may encounter java.lang.IllegalArgumentException: Cannot set target checkpoint to null or GGTranID.UNSET exception when Java operation filtering is enabled.

This issue has been fixed.

Bug 33847292 - DDL changes/Table metadata changes lead to issue in Stage and Merge processing

This issue has been fixed.

Bug 33734218 - BigQuery Handler may propagate large number in scientific notation format when a source numeric field is mapped to a string field in BigQuery.

This issue has been fixed. Change was made to convert numbers from scientific notation to standard form.

3.5 Release 19.1.0.0.13 — January 2022

Upgrade of log4j 2.17.1 to address Security Vulnerability

The following security vulnerability has been fixed: CVE-2021-44832

Oracle recommends that you upgrade to this patch to include these security fixes.

Bug 33270938 - Generic: Rollback should not happen when disabling GROUPTRANSOPS

This issue has been fixed.

3.6 Release 19.1.0.0.12 — January 2022

Upgrade of log4j to address Security Vulnerability

The following security vulnerabilities have been fixed: CVE-2021-45046 and CVE-2021-44228.

Oracle recommends that you upgrade to this patch to include these security fixes.

After you have applied the patch, do the following:

Manually remove the older version of log4j related jar files from ggjava/resources/lib/optional.
In the .properties file of the replicat or extract groups, add the following: gg.log.classpath=ggjava/resources/lib/optional/log4j-api-2.16.0.jar:ggjava/res ources/lib/optional/log4j-core-2.16.0.jar:ggjava/resources/lib/optional/log4j-slf4j-impl-2.16.0.jar

3.7 Release 19.1.0.0.10 — November 2021

Bug 33471061 - Azure storage account key for authentication into ADLS

This issue has been fixed.

Bug 33392133 - The replicat suddenly crashes, and upon restart, a duplicate parquet file gets created.

This issue has been fixed.

Bug 33328546 - Avro Formatter added configuration to allow special handling of Oracle Number source types as string.

This issue has been fixed.

Bug 33322992 - File Writer Handler failing to delete data files on Windows due to process based file locking.

This issue has been fixed. File Writer Handler now implements retries on file delete operations.

Bug 32880283 - Oracle GoldenGate for Big Data replicate creating Parquet files hangs and generate dump files .

This issue has been fixed.

Bug 33298943 - Azure Data Lake File exists error

This issue has been fixed. Parquet Event Handler change to overwrite target files if file already exists.

3.8 Release 19.1.0.0.9 — August 2021

Enh 32804778 - Added metacolumn keyword to provide indication that the metadata for associated table has changed.

This issue has been fixed. The metacolumn ${metadatachanged} has been added. This metacolumn has a boolean value and when true, it indicates that the metadata of the table has changed as of the current record.

Enh 33053571 - Replication to tables on multiple target schemas is now supported.

Bug 33007616 - Initial Load From Cassandra Crash For Out Of Memory

This issue has been fixed.

Bug 32792682 - CassandraCommitLogDirectoryReader - Exception while reading commitlogs .

This issue has been fixed.

Bug 32830352 - Upgraded Apache Commons IO 2.8.0.

This is a Security fix for CVE-2021-29425.

3.9 Release 19.1.0.0.8 — April 2021

Enh 32455419 - Oracle GoldenGate for Big Data: S3 Event handler: Support Canned Access Control List

Support has been added to mutate permissions to the S3 object ACL using S3 Canned Access Control list. For more information, see Configuring the S3 Event Handler in the Oracle GoldenGate for Big Data User Guide.

Bug 32639595 - Avro and Kafka Connect - Error in timestamp logical types when source field is a date or time.

Timestamps sources can propagate as timestamp logical types. Dates and times cannot. This issue is fixed.

Bug 32609848 - Velocity template generates duplicate messages in the File Writer Handler when mode is tx.

This issue has been fixed.

Bug 32492392 - Failing to parse Timestamps from trail.

The issue with parsing timestamp column data from MySQL, PostreSQL, and DB2 sources has been fixed.

Bug 32322155 - GoldenGate Big Data JMS extract abends if decimal number starts with the decimal point.

This issue has been fixed.

Bug 32217448 - Adding trim to columnValue template

This issue has been fixed by adding a functionality to trim the parameter contents of the ${columnValue[]} parameters so that whitespace is supported. For more information, see Using Templates to Resolve the Topic Name and Message Key in the Oracle GoldenGate for Big Data User Guide.

Enh 32200821 - Metacolumn support for seqno and rba

This issue has been fixed. The following Metacolumn keywords have been added to resolve the trail file sequence number and rba respectively: ${seqno} and ${rba}. For more information, see Setting Metacolumn Output in the Oracle GoldenGate for Big Data User Guide.

Bug 32203093 - Secure database password in Oracle Wallet

Cassandra Capture added support to store the password for the Cassandra database in Oracle Wallet.

Bug 32619663 - Kafka Connect Handler to set the namespace and unique name generated row schemas for op formatted messages

Kafka Connect Handler to set the namespace and unique name generated row schemas for op formatted messages. To enable this functionality, the configuration property gg.handler.name.schemaNamespace must be set.

Bug 32430128: Upgrade Jackson Databind library to 2.12.1

The following security bug was fixed:

Enh 32203093: Secure database password inside Oracle Wallet

This issue has been fixed.

CVE-2020-25649

3.10 Release 19.1.0.0.7 — November 2020

Enh 31953602 - Kafka Connect Handler add ability to control the namespace on generated schemas.

Added the configuration property gg.handler.name.schemaNamespace allowing the user better control of generated schema naming. For more information, see Kafka Connect Handler Configuration (Table Kafka Connect Handler Configuration Properties) in Using Oracle GoldenGate for Big Data.

Enh 31936725 - Stage and Merge: Redshift: COPY SQL Authorization enhancement

The Redshift Event Handler has been enhanced to support all the available COPY SQL S3 authorization mechanisms. For more information, see Redshift COPY SQL Authorization in Using Oracle GoldenGate for Big Data.

Enh 31721551 - Token output in the template mapper

The template mapper functionality has been enhanced with a new keyword to resolve token values - ${token[]}. For more information, see Using Templates to Resolve the Stream Name and Partition Name in Using Oracle GoldenGate for Big Data.

Bug 31960873 - Operation Delimited Text Formatter - Injecting 2 line delimiters after truncate operations

This issue has been fixed. The extra line delimiter after truncate operations has been removed.

Bug 31936543 - BigQuery handler : Dataset to be derived from table schema name

The table schema name specified in the replicat map statement has been mapped to the BigQuery dataset name. For more information, see Automated Table Creation in Using Oracle GoldenGate for Big Data.

Bug 32015766 - MongoDb target connection fails with 'Command failed with error 18 (AuthenticationFailed)'

This issue has been fixed.

Bug 31922247 - Kafka formatted message contains incorrect before image portion of the record

This issue has been fixed.

3.11 Release 19.1.0.0.6 — September 2020

Bug 31839295 - The Avro Formatter formatOp operation failed. java.lang.ArithmeticException: Rounding necessary .

This issue has been fixed. The Avro Formatter has implement rounding when the scale setting requires rounding on Avro decimal logical types.

Enh 31814794 - The S3 Event Handler has implemented the ability to change AWS roles when STS is enabled.

This issue has been fixed. See S3 Handler Configuration in Using Oracle GoldenGate for Big Data.

Bug 31786482 - OCI Bucket Creation

This issue has been fixed by changing the bucket creation by the OCI automated bucket creation feature from a public to private access.

3.12 Release 19.1.0.0.5 — August 2020

Bug 31526594 - ADW handler is abending with java.lang.ClassNotFoundException: oracle.jdbc.driver.OracleDriver

This issue has been fixed.

Bug 31524648 - ADW handler abending with ORA-00001: unique constraint error while processing UPSERT

This issue has been fixed.

Bug 31471259 - Remove flume example from AdapterExamples

This issue has been fixed. The flume example has been removed from the AdapterExamples folder.

Bug 31409651 - Oracle GoldenGate for Big Data Replicat Publish Messages to all Destination rather Defined Destination.

This issue has been fixed.

Enh 31404378 - OGGBD: Stage and Merge: ADW: Support compressed updates in the trail

Support has been added for compressed updates in the trail. For more information, see Troubleshooting and Diagnostics in the Using Oracle GoldenGate for Big Data.

Enh 31404362 - OGGBD: Stage and Merge: ADW: XMLTYPE support

An XML cast function has been introduced in the merge SQL to convert the CLOB value in the staging table to XMLTYPE.

Bug 31302830 - NO-OP updates applied even NOAPPLYNOOPUPDATES parameter

This issue has been fixed.

Enh 31316766 - HDFS Event Handler - Log HDFS configuration properites at debug level.

If the log level is set to DEBUG, then the HDFS configuration properties will be logged.

Enh 31202078 - Command Event Handler - Fail at initialization if script does not exist at configured location

This issue has been fixed.

Enh 29722965 - Elasticsearch Handler - Migrate from Transport APIs to High Level Rest Synchronous APIs

Support has been added for Elasticsearch High Level REST client. For more information, see Elasticsearch High Level REST Client Dependancies in the Using Oracle GoldenGate for Big Data.

Enh 30121870 - Stage and Merge support applying to ADW

This issue has been fixed by applying the Stage and Merge support to ADW.

Enh 31182988 - ADW: Support LOB updates

If the GoldenGate trail is generated by Oracle Integrated capture, then for the UPDATE operations on the source LOB column, only the changed portion of the LOB is written to the trail file. For more information, see Using the Autonomous Data Warehouse Event Handler in Using Oracle GoldenGate for Big Data.

Enh 27444427 - Kafka Handler - Add support for Kafka Headers

Kafka and Kafka connect support for headers have been added. For more information, see Using the Kafka Handler and Using the Kafka Connect Handler in Using Oracle GoldenGate for Big Data.

Enh 30564524 - Metacolumns functionality - Add output for primary key column names

The following two metacolumns have been added to the Avro formatters: ${primarykeycolumns} and ${currenttimestampiso8601}. For more information, see Using the Pluggable Formatters in Using Oracle GoldenGate for Big Data.

Bug 31114658 - ADW: External table is not fetching very small/large values in the AVRO file that has Decimal data type

This issue has been fixed.

Bug 31101426 - OGGBD: AVRO file generated by ADW/File writer with JDBC MDP is not correct for the NUMBER data types.

This issue has been fixed. The ADW configuration has been corrected.

Bug 30846809 - ADW handler: ORA-01830: date format picture ends before converting entire input string error

This issue has been fixed by using the following parameters: gg.eventhandler.adw.dateFormat=YYYY-MM-DD HH24:MI:SS and gg.eventhandler.adw.timestampFormat=YYYY-MM-DD HH24:MI:SS.FF9 in the ADW handler.

Bug 29650246 - Jms Extract hanging even after Jms server down

This issue has been fixed.

3.13 Release 19.1.0.0.4 — May 2020

BUG 31235726 - Heartbeat table incorrect buffer handling which caused metadata mismatch on subsequent operations.

This issue was fixed.

BUG 31373926 - OCI Event Handler fails if OCI credentials lack admin privileges to interrogate and create OCI buckets.

This issue was fixed. The Oracle Cloud Infrastructure (OCI) Handler has been modified to work without admin privileges.

ENH 31071500 - Support capture of single record message containing binary data.

This issue has been fixed. Support was added to enable capturing of single record messages containing binary data.

BUG 31208539 - Duplicate record in transaction mode after processing RESTART ABEND record.

This issue was corrected by fixing duplicate operations when handling RESTART_ABEND with DDL operation from the last commit operation.

ENH 31073365 - Support TRIMSPACES, SPACESTONULL in Oracle GoldenGate replicat.

This issue was fixed by implementing missing TRIMSPACES, TRIMVARSPACES and SPACESTONULL parameters in Oracle GoldenGate BigData.

BUG 31256903 - Incorrect before image handling when involving ALLOWDUPTARGETMAP mode.

This issue is fixed by fixing missing BEFORE values when mapping the same source tables to different target tables.

BUG 31010774 Correct OCI Event Handler proxy server configuration.

This issue was fixed by adding the following properties to set the proxy settings: gg.eventhandler.name.proxySever, gg.eventhandler.name.proxyPort,gg.eventhandler.name.proxyProtocol, gg.eventhandler.name.proxyUsername, and gg.eventhandler.name.proxyPassword. For more information about these properties, see Configuring the Oracle Cloud Infrastructure Event Handler in the Using Oracle GoldenGate for Big Data Guide.

BUG 31297753 Upgrade log4j to version 2.13.2

The following security bug was fixed:

CVE-2020-9488

3.14 Release 19.1.0.0.3 — March 2020

BUG 30926357 - Property gg.handler.name.EnableTimestampLogicalType is not getting enabled with gg.format.timestamp

The feature to enable logical timestamps in Kafka Connect and Avro is not working when the content regex replacement feature is also enabled. This issue is fixed.

BUG 29875647 - Extract abends with error code 16002 when source data contains newlines

This issue has been fixed.

BUG 30843726 - Unable to Selected Parquet Writer Versions.

A new property gg.eventhandler.name.writerVersion has been added on the Parquet Event Handler to support the explicit selection of the Parquet writer version.

BUG 31038699 - OCI Event Handler - Does not work with 1.5.x+ versions of the OCI SDK

The version of the OCI Java SDK has been moved up in order to support newer regions. If the OCI Event Handler is used, then you must use version 1.5.4 or higher of the OCI Java SDK.

BUG 30916397 - HDFS Handler - Roll on Metadata change is broken

This issue is fixed.

BUG 30752010 Security Bug

The following security vulnerabilities have been fixed:

CVE-2019-16943
CVE-2019-19267
CVE-2019-17531

BUG 31018223 Security Bug

The following reported security vulnerabilities have been fixed:

CVE-2020-8840
CVE-2020-9546
CVE-2020-9547
CVE-2019-14892
CVE-2019-14893

3.15 Release 19.1.0.0.2 — January 2020

Bug 25106122 - Possible SQL injection in Hive automated table creation.

The possible SQL injection in automated Hive table creation functionality was fixed.

30318721 - CVE-2018-11058: ORACLE SECURITY SERVICE UPGRADE

The following security vulnerabilities were fixed:

CVE-2018-11058
CVE-2016-0701
CVE-2016-2183
CVE-2016-6306
CVE-2016-8610
CVE-2018-11054
CVE-2018-11055
CVE-2018-11056
CVE-2018-11057
CVE-2018-15769

3.16 Release 19.1.0.0.1— October 2019

ENH 30153046 - JMS Extract is failing with date format error - [ERROR]: Could not convert date using format YYYY-MM-DD:HH:MI:SS.FFFFFFFFF

This release contains an improvement in JMS capture to support parsing multiple precisions of timestamp data.

BUG 30220338 - Oracle Golden Gate Big Data Adapter Kafka Connect Handler not able to generate decimal timestamps

This release contains an improvement in Kafka Connect handler to support Avro logical types.

BUG 30110907 - SQL Server to AWS S3, OGG-15051 Java or JNI exception: java.lang.NoClassDefFoundError: oracle/goldengate/datasource/UserExitMain.

This release adds a new S3 event handler configuration to allow users to disable S3 bucket administration (for example, create bucket). Default: true, which means the S3 event handler can potentially try to verify and create bucket if it doesn’t exist.

ENH 29873179 - how to get the offset value from response in Goldengate for Big DataThis release adds debug logging in Kafka handler to log topic, partition, and offset upon successful sent messages.

3.16.1 Critical Security Updates — October 2019

Critical Security Fixes

This release includes critical security fixes including the following CVEs. Oracle strongly recommends that you upgrade to this release of Oracle GoldenGate for Big Data and Oracle GoldenGate CVE-2018-11058.

The following security fixes are provided in the Oracle GoldenGate for Big Data 19.1.0.0.1 release:

CVE-2019-16335 (Bug: 30347733): This affects the jackson-databind component.
CVE-2019-14439 (Bug: 30172810): This affects the jackson-databind component.
CVE-2018-8088 (Bug: 30172807): This affects the slf4j component.

The update for CVE-2018-11058 also addresses the following:

CVE-2016-0701
CVE-2016-2183
CVE-2016-6306
CVE-2016-8610
CVE-2018-11054
CVE-2018-11055
CVE-2018-11056
CVE-2018-11057
CVE-2018-15769

For more information, see Oracle Critical Patch Update Advisory.

3.17 Release 19.1.0.0.0 — August 2019

Bug 29548820 — When issued STOP *, all groups go into ABENDED status.

Extract was changed to set the checkpoint ready status to false when processing a SQL operation record, which corrected the erroneous abended status.

Bug 29507343 — Specific HP NonStop data types incorrectly converted in OGGBD.

A mapping issue when handling decimal with decimal point types from HP NonStop was fixed.

Bug 28065055 — Replicat SIGSEGV when processing GG_HEARTBEAT records

Replicat was changed to handle the mapping of heartbeat tables by automatically creating the target table definition.

Enh 29719124 — Enable MAPINVISIBILECOLUMMS functionality for non-Oracle targets.

The MAPINVISIBLECOLUMNS replicat configuration property is now supported for non-Oracle targets.

Bug 28507572 — Incorrect lag reported by pmsrvr

Negative lag in pmsrvr was reported as very high positive lag. Issue is fixed.

Enh 29689282 — Elasticsearch Handler add support for Elasticsearch 7.x.

The Elasticsearch Handler now supports Elasticsearch version 7.x.

Enh 29631406 — Delimited Text Formatter enhanced to output both before and after image data.

Prior to the Oracle GoldenGate for Big Data 19.1.0.0 release, the Delimited Text Formatter could only output after image data for inserts and updates, and before image data for deletes. The Delimited Text Formatter can now be optionally configured to output both before and after image data for inserts, updates, and deletes.

Enh 29624591 — Java Adapter configuration framework modified to trim trailing whitespace from configuration values.

The Java Adapter configuration framework was modified to trim trailing whitespace characters from configuration values.

Enh 29314345 — HBase Handler added support for HBase 2.x

The HBase Handler was modified to support HBase 2.x.

Enh 29250231 — MongoDB Handler added support for transactions.

The MongoDB Handler add optional support for transactions. Support for transactions was added in the 4.0 version of MongoDB.

Enh 29357124 — HBase Handler default functionality was changed to set timestamps for HBase operations from the HBase Handler

The default functionality of the HBase Handler was changed to set the set timestamps for HBase operations from the HBase Handler. Prior to the Oracle GoldenGate for Big Data 19.1.0.0 release, the default value for gg.handler.hbase.setHbaseOperationTimestamp was false. Starting with the Oracle GoldenGate for Big Data 19.1.0.0 release, the default value is true.