Prepare

Supported Databases for Compare

Oracle GoldenGate Veridata supports the following databases for comparisons:

Note: Only NoSQL source to NoSQL target comparisions are supported.

For the latest information about Oracle GoldenGate Veridata release, including the list of certified database versions and operating systems, go to My Oracle Support at http://support.oracle.com.

Supported Databases for Repair

Oracle GoldenGate Veridata supports the following databases for repair functionality:

For the latest information about Oracle GoldenGate Veridata release, including the list of certified database versions and operating systems, go to My Oracle Support at http://support.oracle.com.

Supported Databases for Repair SQL

Oracle GoldenGate Veridata supports the following target databases for Repair SQL functionality:

Supported Datatypes

Supported Datatypes - Oracle

The Oracle GoldenGate Veridata supports the listed datatypes for the Oracle database:

For Oracle Boolean Data Type

Limitations and Clarifications:

Both Object types and Collection types UDTs are supported

Supported Datatypes - Microsoft SQL Server

The Oracle GoldenGate Veridata supports the listed datatypes for the SQL Server database:

For more information about conversion of SQL Server data types to Oracle data types, see Data Type Conversion in Database Gateway for SQL Server User’s Guide.

Supported Datatypes - PostgreSQL

The Oracle GoldenGate Veridata supports the listed datatypes for PostgreSQL:

Non-Supported PostgreSQL Data Types

For Postgres BIT Varying Data Type

Limitations of Support

Supported Datatypes - MySQL, MariaDB

The Oracle GoldenGate Veridata supports the listed datatypes for the MySQL, MariaDB databases:

For MySQL BIT Data Type

Limitations and Clarifications

Supported Datatypes - DB2 LUW

The Oracle GoldenGate Veridata supports the listed datatypes for the DB2 LUW database:

Supported Datatypes - DB2 for i

The Oracle GoldenGate Veridata supports the listed datatypes for DB2 for i:

Limitations and Clarifications

Supported Datatypes - DB2 z/OS

The Oracle GoldenGate Veridata supports the listed datatypes for the DB2 z/OS database:

Supported Datatypes - Sybase Adaptive Server Enterprise

The Oracle GoldenGate Veridata supports the listed datatypes for the Sybase database:

Supported Datatypes - Teradata Vantage

The Oracle GoldenGate Veridata supports the listed datatypes for the Teradata database:

Supported Datatypes - Snowflake

The Oracle GoldenGate Veridata supports the listed datatypes for the Snowflake database:

Non-Supported Snowflake Data Types

Supported Datatypes - SingleStore Database

The Oracle GoldenGate Veridata supports the listed datatypes for the SingleStore database:

Supported Datatypes - Databricks

The Oracle GoldenGate Veridata supports the listed datatypes for Databricks:

Generic Limitations and Clarifications

This topic lists a few generic limitations and clarifications:

Oracle GoldenGate Veridata Agent System Requirements

One Oracle GoldenGate Veridata Agent must be installed for each database instance that contains data that is to be compared. At minimum, therefore, you will install two agents - one to retrieve source rows and one to retrieve target rows (unless you are comparing data within the same database instance). One agent can retrieve rows from multiple databases or schemas within a given database instance. However, one agent cannot retrieve rows from different database instances.

Comparing Multi-Byte Data

The following considerations apply when you are comparing tables with multibyte data:

Disk and Memory Requirements for the Agent Component

Database Privileges for the Agent Component

Oracle GoldenGate Veridata Agent makes use of a database login, which must be created before you can run comparisons. You provide the login and password when you configure connection objects in the Oracle GoldenGate Veridata Web interface. The following are the database privileges that are required for the database user.

Required database privileges for Oracle GoldenGate Veridata Agent

IBM Db2

Oracle Database

HPE NonStop

Microsoft SQL Server

Sybase Adaptive Server Enterprise

Teradata Vantage

Apache Hive

SELECT privileges on the tables to be compared.

Required Database Privileges for Using the Repair Feature

For all databases, the database user must have the UPDATE, INSERT, and DELETE privileges on the tables to be repaired.

For Sybase database, if the table has triggers and suppression of triggers enabled, the database user must have the replication_role privilege.

For SQL Server database, If the table being repaired has ‘identity columns’, the Repair User specified must be either the table owner, or should have ALTER permission on the table that is being repaired.

Oracle GoldenGate Veridata Server System Requirements

This section describes the installation location, additional programs, disk, memory, and repository requirements for Oracle GoldenGate Veridata Server.

Oracle GoldenGate Veridata server is designed to run on a dedicated Linux host only. Ensure to stop all other applications and remove any MySQL instances before server install to avoid port conflicts.

Oracle recommends that you use the certification matrix and system requirements documents with each other to verify that your environment meets the requirements for installation. See GoldenGate Certifications.

Location for the Server Component

The server and web user interface components are installed from one installation program on Linux systems. The installer includes all files that are needed to run those programs. One installation can be used for comparisons among all of the supported databases, but multiple installations can be used as needed.

Do not install the server and web user interface components on a NonStop system. To use Oracle GoldenGate Veridata for NonStop databases:

Disk and Memory Requirements for the Server Component

The server component uses about 200 MB of fixed virtual memory for basic tasks. The remaining virtual memory is used for comparisons. The main consumers of processing resources on the Oracle GoldenGate Veridata machine are the row sorting operations of the initial comparison step when using server-side sorting.

Enough combined disk space and virtual memory is needed to store all of the rows that are sent for comparison from the source and target systems. To estimate the amount of memory per row:

((number of cols in key + 1) * 4) + 16 + (comparison width of a key col)

Where:

comparison width of a key col depends on the comparison format that is selected by Oracle GoldenGate Veridata (or a user override) to use for a comparison.

Comparison format data sizes:

Comparison Format Data Size
Numbers One byte for each significant digit. Leading zeros and trailing zeros after the decimal point (such as the right most zeros in 1234.500) are not counted.
Timestamp 19 to 32 bytes depending on the fractional precision.
Date 10 bytes.
Time 8 to 18 bytes depending on the fractional precision.
String 1 to 4 bytes per character for the UTF-8 encoding of the Java agent. The NonStop agent uses the database native character set.
Binary The bytes as stored in the database.

For example, the number 109998877, if compared as a decimal float, would require:

((1 + 1) * 4) + 16 + 9 = 33bytes of memory for this row

Note: This assumes that all non-key columns are compared by using a hash, not literally. More space is needed for literal comparisons

Oracle GoldenGate Veridata uses an external merge sort to sort the data. As data is received from the agent, the rows are sorted in memory. When a memory buffer is full, the sorted rows are written to disk.

In order to sort the data, the sort process matches the initial data set size for temporary storage space. The required amount of temporary space is determined by the number of rows, the row size, and the amount of available sort memory. The following cases illustrate the different modes of the sort depending on the available resources.

Beyond this allocation, memory is required for storing rows during the second step of processing, the confirmation step. This can be up to 20 MB if you expect a large number of rows to require confirmation, as is usually the case when replication latency is very high. These rows are staged in the main memory before they are confirmed.

On 64-bit systems, more memory can be addressed, so more data can be stored in main memory instead of on slower disk devices. The memory that is used in the initial comparison step is not necessarily all released at once to be available for the confirmation step. Consequently, some memory will be shared between processes. When the sort cannot hold all of the rows in memory, it uses disk storage.

When deciding how much memory to allocate, be aware of the following ways that you can manage it with parameter settings within the Oracle GoldenGate Veridata application:

Oracle GoldenGate Veridata Distribution

This topic details how to download the files of Oracle GoldenGate Veridata files and C-Agent.

Downloading Oracle GoldenGate Veridata

A distribution is an archive file containing an installer; when you run the installer, the set of Oracle GoldenGate Veridata components and feature that are included with the distribution are installed. You will need a certified JDK on your system in order to be able to run the installer. For more information, see Prerequistes in Installing and Running Oracle GoldenGate Veridata

You can download Oracle GoldenGate Veridata from the Oracle GoldenGate Downloads page at https://www.oracle.com/middleware/technologies/goldengate-downloads.html and from the Oracle Software Delivery Cloud site, at https://edelivery.oracle.com/osdc/faces/SoftwareDelivery.

The following table describes the products and feature sets in Oracle GoldenGate Veridata.

Table 1 Oracle GoldenGate Veridata Product

Product Feature Set Description

Oracle GoldenGate Veridata

Veridata Server

The Veridata Server component includes the web server, the web application, and command-line utilities such as vericom .

Veridata Agent

This component installs only the Veridata Agent.

Internal Features

OPatch

The OPatch utility is a tool that allows the application and rollback of interim patches to Oracle products.

Downloading Oracle GoldenGate Veridata C-Agent and Java Agent

Oracle GoldenGate Veridata C-Agent and the Java Agent platforms are available for download on Oracle Technology Network Oracle GoldenGate Downloads page at: http://www.oracle.com/technetwork/middleware/goldengate/downloads/index.html