MySQL: Supported Data Types, Objects, and Operations
This section contains support information for Oracle GoldenGate on MySQL Database.
Oracle GoldenGate for MySQL supports the mapping, filtering, and transformation of source data, unless noted otherwise in this document, along with replicating data derived from other source databases supported by Oracle GoldenGate, into MySQL databases.
Oracle GoldenGate for MySQL Supported Data Types
Oracle GoldenGate for MySQL supports the following data types:
-
BLOB
-
BIGINT
-
BINARY
-
BIT(M)
-
CHAR
-
DATE
-
DATETIME
-
DECIMAL
-
DOUBLE
-
ENUM
-
FLOAT
-
INT
-
JSON
-
LONGBLOB
-
LONGTEXT
-
MEDIUMBLOB
-
MEDIUMINT
-
MEDIUMTEXT
-
SMALLINT
-
TEXT
-
TIME
-
TIMESTAMP
-
TINYBLOB
-
TINYINT
-
TINYTEXT
-
VARBINARY
-
VARCHAR
-
VECTOR
-
YEAR
Limitations and Clarifications
When running Oracle GoldenGate for MySQL, be aware of the following:
-
Functional indexes are not supported for Capture or Delivery.
-
Oracle GoldenGate does not support
BLOB
orTEXT
types when used as a primary key. -
Oracle GoldenGate supports a
TIME
type range from 00:00:00 to 23:59:59. -
Oracle GoldenGate supports timestamp data from
0001/01/03:00:00:00
to9999/12/31:23:59:59
. If a timestamp is converted from GMT to local time, these limits also apply to the resulting timestamp. Depending on the time zone, conversion may add or subtract hours, which can cause the timestamp to exceed the lower or upper supported limit. -
Oracle GoldenGate does not support negative dates.
-
The support of range and precision for floating-point numbers depends on the host machine. In general, the precision is accurate to 16 significant digits, but you should review the database documentation to determine the expected approximations. Oracle GoldenGate rounds or truncates values that exceed the supported precision.
-
When you use
ENUM
type in non-strictsql_mode
, the non-strictsql_mode
does not prevent you from entering an invalidENUM
value and an error will be returned. To avoid this situation, do one of the following:-
Use
sql_mode
asSTRICT
and restart Extract. This prevents users from entering invalid values for any of the data types. An IE user can only enter valid values for those data types. -
Continue using non-strict
sql_mode
, but do not useENUM
data types. -
Continue using non-strict
sql_mode
and useENUM
data types with valid values in the database. If you specify invalid values, the database will silently accept them and Extract will abend.
-
-
Table with single column is not supported for JSON datatype. Extract will abend in case it is configured for a table which has a single column of
JSON
datatype. -
JSON
datatype does not support CDR. The following message gets logged in the report file ifGETBEFORECOLS
is configured and the table has columns ofJSON
datatypes:INFO OGG-06556 The following columns will not be considered for CDR
The limtations for CDR applies to cases where the
GETBEFORECOLS
andCOMPARECOLS
are used.
Non-Supported MySQL Data Types
Oracle GoldenGate for MySQL does not support the following data types:
All spatial types
(GEOMETRY
and so on), and SET
.
All the following GEOMETRY
types are unsupported in MySQL:
-
POINT
-
LINESTRING
-
POLYGON
-
MULTIPOINT
-
MULTILINESTRING
-
MULTIPOLYGON
-
GEOMCOLLECTION
Note:
Extract abends if it is configured to capture from tables that contain any of the unsupported data types, so ensure that Extract is not configured to capture from tables containing columns of unsupported data types.
Supported Objects and Operations for MySQL
Oracle GoldenGate for MySQL supports the following objects and operations:
-
Oracle GoldenGate supports the following DML operations on source and target database transactional tables:
-
Insert operation
-
Update operation (compressed included)
-
Delete operation (compressed included)
-
Truncate operation
-
-
Oracle GoldenGate supports the extraction and replication of DDL (data definition language) operations.
-
Oracle GoldenGate supports transactional tables up to the full row size and maximum number of columns that are supported by MySQL and the database storage engine that is being used. InnoDB supports up to 1017 columns.
-
Generated columns are supported and captured.
-
Oracle GoldenGate supports the
AUTO_INCREMENT
column attribute. The increment value is captured from the binary log by Extract and applied to the target table in a Replicat insert operation. -
Oracle GoldenGate can operate concurrently with MySQL native replication.
-
Oracle GoldenGate supports the
DYNSQL
feature for MySQL.Note:
XA transactions are not supported for capture and any XA transactions logged inbinlog
cause Extract to abend. So, you must not use XA transactions against a database that Extract is configured to capture.If XA transactions are being used for databases that are not configured for Oracle GoldenGate capture, then exclude those databases from logging into MySQL binary logs by using the parameter
binlog-ignore-db
in the MySQL server configuration file.Limitations on Automatic Heartbeat Table support are as follows:
-
Ensure that the database in which the heartbeat table is to be created already exists to avoid errors when adding the heartbeat table.
-
In the heartbeat history lag view, the information in fields like
heartbeat_received_ts
,incoming_heartbeat_age
, andoutgoing_heartbeat_age
are shown with respect to the system time. You should ensure that the operating system time is setup with the correct and current time zone information.
-
-
Position by End of File (EOF) is supported in MySQL. Oracle GoldenGate Extract for MySQL finds the position corresponding to the end of the file and starts reading transactions from there. The EOF position is not exact, if data is continuously written to the binary log.
The Extract is added and altered using:ADD EXTRACT group_name, TRANLOG, EOF
ALTER EXTRACT group_name, EOF
Details of Support for Objects and Operations in MySQL DDL
-
DDL replication for MySQL is only supported between MySQL databases as sources and targets.
-
Extraction and replication of DDL operations are supported for MySQL 8.0 and higher. The supported DDL operations include:
-
CREATE TABLE
(excludingCREATE TABLE AS SELECT
) -
DROP TABLE
-
TRUNCATE TABLE
(Support usingGETTRUNCATES
) -
ALTER TABLE TRUNCATE PARTITION
-
ALTER TABLE ADD COLUMN
-
ALTER TABLE ADD COLUMN AFTER
-
ALTER TABLE DROP COLUMN
-
ALTER TABLE MODIFY COLUMN
(COLUMN_NAME
,TYPE
,SIZE
) -
ALTER TABLE ADD (constraints) PRIMARY KEY
-
ALTER TABLE DROP PRIMARY KEY
-
-
For MySQL 8.0, local and remote DDL capture is supported.
-
TRUNCATE
operations are supported as DML through theGETTRUNCATES
Extract and Replicat parameter and do not require configuring Oracle GoldenGate for MySQL DDL support. -
DDL replication is not supported in a Oracle GoldenGate bi-directional configuration.
-
DDL replication is not supported for cloud based database services where the
binlog_row_metadata
database setting cannot be set toFULL
.
Non-Supported Objects and Operations for MySQL
Oracle GoldenGate for MySQL does not support the following objects and operations:
-
Invisible columns
-
The Oracle GoldenGate
BATCHSQL
feature for Replicat. -
The following character sets are not supported:
- ULIB_CS_ARMSCII8, /* American National 166-9 */
- ULIB_CS_GEOSTD8, /* Geogian Standard */
- ULIB_CS_KEYBCS2, /* Kemennicky MS-DOS
-
Capturing NLS LOB data using the
FETCHMOCOLS
andFETCHMODCOLEXCEPT
TABLE options is not supported when DDL is enabled. -
Renaming tables.
-
DDL statements inside stored procedures is not supported.
-
When the time zone of the Oracle GoldenGate installation server does not match the time zone of the source database server, then the TIMESTAMP data sent to the target database will differ from the source database. For Oracle GoldenGate Microservices installations, regardless of the time zones being the same, Extract will resolve the time zone to UTC. Determine the source database time zone by running the following query:
select @@system_time_zone;
This will return a time zone value, such as PDT.
Create a variable in the deployment that contains the source Extract, called
TZ
and set it to the value of the source database time zone. After this, stop any running Oracle GoldenGate processes and restart the Administration Service, and then start the Extracts and Replicats. -
Extraction and replication from and to views is not supported.
-
Transactions applied by the slave are logged into the relay logs and not into the slave's
binlog
. If you want a slave to write transactions thebinlog
that it receives from the master , you need to start the replication slave with the log slave-updates option as 1 inmy.cnf
. This is in addition to the other binary logging parameters. After the master's transactions are in the slave'sbinlog
, you can then setup a regular capture on the slave to capture and process the slave'sbinlog
.
Limitations of SingleStoreDB Objects and Operations
Oracle GoldenGate for MySQL now supports SingleStoreDB and SingleStoreDB Cloud, but with the following limitations:
-
Replication to views within SingleStoreDB are not supported, as only the base tables are writeable.
-
Updates to columns that are part of the
SHARD
key are not supported. -
Primary key updates on tables with no explicit
SHARD
key are not supported. This is because SingleStoreDB assigns the primary key as theSHARD
key in this situation, and updates toSHARD
key columns are not allowed. -
The
DBOPTIONS LIMITROWS
behavior of Replicat for SingleStoreDB tables without a primary or unique key that are spread across multiple partitions, is not supported. -
The
DBOPTIONS LIMITROWS
andNOLIMITROWS
parameter options are not supported for SingleStoreDB. -
SingleStoreDB does not support cross-database transactions, which means that a Replicat can only support mapping to a single schema/database. This includes mappings for checkpoint and heartbeat tables, so these objects must be created under the same schema/database as the user tables to be replicated.