1 Introduction

Important: About Service Restarts

On the Hadoop-side installation, the following restarts may occur.

• Cloudera Configuration Manager (or Ambari) may be restarted. This in itself does not interrupt any services.

• Hive, YARN , and any other services that have a dependency on Hive or YARN (such as Impala) are restarted.

  The Hive libraries parameter is updated in order to include Oracle Big Data SQL JARs. On Cloudera installations, if the YARN Resource Manager is enabled, then it is restarted in order to set cgroup memory limit for Oracle Big Data SQL and the other Hadoop services. On Oracle Big Data Appliance, the YARN Resource Manager is always enabled and therefore always restarted.

  Note:

  The Oracle Big Data SQL installation script includes this message in its output:

  BigDataSQL: Restarting cluster...
  

  The restart is limited to “stale” components of the cluster, which can include Hive, YARN, and their dependent services.

On the Oracle Database server(s), the installation may require a database and/or Oracle Grid infrastructure restart in environments where updates are required to cell settings on the Grid nodes. See Potential Requirement to Restart Grid Infrastructure for details.

How Long Does It Take?

The installation on the Hadoop cluster may take approximately 30 minutes. The generation of the installation bundle for the database side requires a download Hadoop and Hive clients and other software. This may take 20 additional minutes, depending on Internet download speed. The average installation time for the database side can be estimated as follows:

• 15 minutes for a single node database if a restart is not required. If a restart is required, the time will vary, depending on the size of the database.

• On a RAC database, multiply the factors above by the number of nodes.

• If an Oracle Grid restart is required, factor that in as well.

Outline of the Installation Steps

This is the sequence of tasks for installing Oracle Big Data SQL.

1. Before you start:

   • Check the Oracle Big Data SQL Master Compatibility Matrix (Document 2119369.1 in My Oracle Support) for general platform compatibility.

   • Check Installation Prerequisites in this guide for required software.

   • Login credentials that you will need:

     • root credentials for both the Hadoop cluster and all Oracle Grid nodes.

       On the grid nodes you have the option of using passwordless SSH with the root user instead.

     • oracle Linux user (or other, if the database owner is not oracle)

     • The Oracle Grid user (if this is not the same as the database owner).

     • The Hadoop configuration management service (CM or Amabari) admin password.

2. On the cluster management server (where CM or Ambari is running), download the software from Oracle. (See Downloading Oracle Big Data SQL.)

3. On the cluster management server, check to see if Python 2.7 is installed, as described in Installation Prerequisites.

4. Perform the Hadoop-side installation described in Installing the Hadoop Side of Oracle Big Data SQL.

   The Hadoop-side phase of the installation does the following:

   • Deploys Oracle Big Data SQL binaries along the cluster.

   • Configures Linux and network settings for the service on each cluster node.

   • Configures the BDS service on the cluster management server.

   • Acquires information needed to configure Oracle Database connections to the cluster.

5. On the Hadoop cluster management server, run the scripts to create the bundle that installs Oracle Big Data SQL on the Oracle Database side. (Described in Creating the Database-Side Installation Bundle.)

6. Perform the Oracle Database server-side installation. (See Installing the Oracle Database Side of Oracle Big Data SQL.)

   In this phase of the installation, you deploy the database-side installation bundle that you generated to the database nodes. Extract it from the zip file and run it.

   The database-side installer does the following:

   • Copies the Oracle Big Data SQL binaries to the database node.

   • Configures network settings for the service.

   • Inserts cluster metadata into Oracle Database.

   Important:

   Be sure to install the bundle on each compute node. The Hadoop-side installation automatically propagates the Oracle Big Data SQL software to each DataNode of the Hadoop cluster. However, the database-side installation does not work this way. You must copy the software to each database compute node and install it directly.

   In Oracle Grid environments, if cell settings need to be updated then the installer will alert you if a grid restart will be needed. (Be sure to have the grid password because if the grid restart is required, then the installation will not complete without these credentials.)

Installation Log Files

On the Hadoop cluster side:

/var/log/bigdatasql 
/var/log/oracle

On the Oracle Database side:

$ORACLE_HOME/install/bds* (This is a set of files, not a directory) 
$ORACLE_HOME/bigdatasql/logs 
/var/log/bigdatasql

You can download Oracle Big Data SQL from the Oracle Software Delivery Cloud