C Oracle Big Data SQLインストールの例

Oracle Big Data SQLインストールのコンソール出力のサンプルを次に示します。

例1は、Oracle Big Data Applianceでのインストールの出力を示しています。
例2は、Hortonworks HDPでのパラレル・インストールを示しています。

インストールのデータベース側は、Exadata Database MachineおよびすべてのコモディティOracle Databaseプラットフォームで同じです。

これらのデータベース側のスクリプトは、Oracle Database 12.1を実行しているシステムへのインストールを示しています。出力は、Oracle Database 12.2のシステムにインストールする場合と同じですが、マイナー・パスが異なります。

例1: Oracle Big Data Applianceでのインストール

この例では、HadoopシステムがOracle Big Data ApplianceであるHadoop側のインストールを示しています。このシナリオで注意する要素は次のとおりです。

重要:

Pythonの適切なバージョンが呼び出されるようにsclを使用していることに注意してください。

[root@clust0601bda14vm03 BDSjaguar-3.2.1]# scl enable python27 "./jaguar install"
BigDataSQL: =======================================================================.
BigDataSQL: Oracle Big Data SQL 3.2.1.
BigDataSQL: Starting execution on: Mon Nov 13 13:47:13 2017.
BigDataSQL:          in directory: /root/BDSjaguar-3.2.1.
BigDataSQL:          and hostname: clust0601bda14vm03.vm.oracle.com.
BigDataSQL: Verifying configuration parameters...
BigDataSQL: Starting server...
BigDataSQL: API protocol: http.
BigDataSQL: API port: 7180.
BigDataSQL: Waiting for management server to respond...
BigDataSQL: WARNING: If there are services in the stale state, they will be restarted !!!.

Cloudera Manager user: admin
Password:

BigDataSQL: Authentication succeeded.
BigDataSQL: API version: 17.
BigDataSQL: Cluster type: BDA.
BigDataSQL: Cluster name: clust0601bda14vm.
BigDataSQL: Cluster version: CDH5.
BigDataSQL: Service: BIGDATASQL.
BigDataSQL: Verifying service configuration..
BigDataSQL: Connection type: Ethernet.
BigDataSQL: Initialization completed..
BigDataSQL: Copying CSD to Cloudera Manager..
BigDataSQL: Restarting management server...
BigDataSQL: Waiting for management server to respond...
BigDataSQL: Restarting Cloudera Management service..
BigDataSQL: Starting deployment server..
BigDataSQL: Deployment server listening
BigDataSQL: Analyzing cluster ....
BigDataSQL: Checking for Big Data SQL requirements..
BigDataSQL: Preparing installation..
BigDataSQL: Installing Big Data SQL agents..
BigDataSQL: No http_proxy variable defined.
BigDataSQL: No https_proxy variable defined.
BigDataSQL: Installing Big Data SQL servers..
BigDataSQL: Starting bigdatasql service..
BigDataSQL: Restarting stale services..
BigDataSQL: Restarting Cloudera Management service..
BigDataSQL: Big Data SQL task completed..
BigDataSQL: Creating database side bundle..
BigDataSQL: Creating bundle file.
BigDataSQL: Bundle file created: /root/BDSjaguar-3.2.1/db-bundles/bds-3.2.1-db-clust0601bda14vm-171113.1347.zip.
BigDataSQL: WARNING: Database authentication is enabled, you will need a reqkey file for set it up..
BigDataSQL:          Ignore this warning if you already have one or if your database already has its key,
BigDataSQL:          otherwise, use './jaguar --requestdb <db name> databasereq' to create one.
BigDataSQL: INSTALL workflow completed.

データベースmashadbの.reqkeyファイルのリクエスト。データベース認証は有効ですが、インストール操作でキーはリクエストされませんでした。

[root@clust0601bda14vm03 BDSjaguar-3.2.1]# scl enable python27 "./jaguar --requestdb mashadb databasereq"
BigDataSQL: =======================================================================.
BigDataSQL: Oracle Big Data SQL 3.2.1.
BigDataSQL: Starting execution on: Mon Nov 13 14:07:21 2017.
BigDataSQL:          in directory: /root/BDSjaguar-3.2.1.
BigDataSQL:          and hostname: clust0601bda14vm03.vm.oracle.com.
BigDataSQL: Verifying configuration parameters...
BigDataSQL: Starting server...
BigDataSQL: API protocol: http.
BigDataSQL: API port: 7180.
BigDataSQL: Waiting for management server to respond...
BigDataSQL: WARNING: If there are services in the stale state, they will be restarted !!!.

Cloudera Manager user: admin
Password:

BigDataSQL: Authentication succeeded.
BigDataSQL: API version: 17.
BigDataSQL: Cluster type: BDA.
BigDataSQL: Cluster name: clust0601bda14vm.
BigDataSQL: Cluster version: CDH5.
BigDataSQL: Service: BIGDATASQL.
BigDataSQL: Verifying service configuration..
BigDataSQL: Connection type: Ethernet.
BigDataSQL: Initialization completed..
BigDataSQL: Starting deployment server..
BigDataSQL: Deployment server listening
BigDataSQL: Requiring database keys only..
BigDataSQL: reqkey file created: /root/BDSjaguar-3.2.1/dbkeys/mashadb.reqkey.
BigDataSQL: DATABASEREQ workflow completed.

データベース側のインストール・バンドルおよびリクエスト・キー・ファイルをデータベース・ノードにコピーします。

[root@clust0601bda14vm03 BDSjaguar-3.2.1]# scp /root/BDSjaguar-3.2.1/dbkeys/mashadb.reqkey masha@clust0601bda14vm04:/home/masha
masha@clust0601bda14vm04's password:
mashadb.reqkey                                                                                  100%  252     0.3KB/s   00:00
[root@clust0601bda14vm03 BDSjaguar-3.2.1]# scp /root/BDSjaguar-3.2.1/db-bundles/bds-3.2.1-db-clust0601bda14vm-171113.1347.zip masha@clust0601bda14vm04:/home/masha
masha@clust0601bda14vm04's password:
bds-3.2.1-db-clust0601bda14vm-171113.1347.zip                                                    100% 1020MB  51.0MB/s   00:20

バンドルを解凍し、実行ファイルを実行し、実行ファイルによって作成されるインストール・ディレクトリにリクエスト・キー・ファイルをコピーします。

[masha@clust0601bda14vm04 ~]$ unzip bds-3.2.1-db-clust0601bda14vm-171113.1347.zip
Archive:  bds-3.2.1-db-clust0601bda14vm-171113.1347.zip
  inflating: bds-3.2.1-db-clust0601bda14vm-171113.1347.run
[masha@clust0601bda14vm04 ~]$ ./bds-3.2.1-db-clust0601bda14vm-171113.1347.run
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: platform is               : Linux
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: script started at         : Mon Nov 13 14:19:56 CST 2017
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: running location          : /home/masha
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: ORACLE_SID                : mashadb
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: ORACLE_HOME               : /u03/app/masha/12.1.0/dbhome_mashadb
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: install directory         : /u03/app/masha/12.1.0/dbhome_mashadb/BDSJaguar-3.2.1/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: extracting...
bds-3.2.1-db-clust0601bda14vm-171113.1347.run: installer extracted successfully

cd $ORACLE_HOME/BDSJaguar-3.2.1/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com

bds-3.2.1-db-clust0601bda14vm-171113.1347.run: for setup Big Data SQL on this database instance
[masha@clust0601bda14vm04 ~]$ mv mashadb.reqkey $ORACLE_HOME/BDSJaguar-3.2.1/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com

インストール・ディレクトリに移動し、bds-database-install.shのインストール操作を実行します。

[masha@clust0601bda14vm04 ~]$ cd $ORACLE_HOME/BDSJaguar-3.2.1/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com
[masha@clust0601bda14vm04 clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com]$ ./bds-database-install.sh --install
bds-database-install: platform is               : Linux
bds-database-install: script started at         : Mon Nov 13 14:20:59 CST 2017
bds-database-install: running location          : /u03/app/masha/12.1.0/dbhome_mashadb/BDSJaguar-3.2.1/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com
bds-database-install: ORACLE_SID                : mashadb
bds-database-install: ORACLE_HOME               : /u03/app/masha/12.1.0/dbhome_mashadb
bds-database-install: configuration spfile      : spfilemashadb.ora
bds-database-install: Grid home                 : not detected
bds-database-install: db resource               : mashadb
bds-database-install: mta extproc sid           : bds_mashadb_clust0601bda14vm
bds-database-install: use of crsctl             : false
bds-database-install: root shell script /u03/app/masha/12.1.0/dbhome_mashadb/install/bds-database-install-10657-root-script-clust0601bda14vm.sh
please run as root:

<enter> to continue checking.. 
q<enter> to quit


bds-database-install: root script seem to have succeeded, continuing...
bds-database-install: cluster type              : bda
bds-database-install: connection type           : Ethernet
bds-database-install: cluster name              : clust0601bda14vm
bds-database-install: dictionary cluster name   : clust0601bda14vm
bds-database-install: Hadoop version            : hadoop-2.6.0-cdh5.12.1
bds-database-install: Hive version              : hive-1.1.0-cdh5.12.1
bds-database-install: HBase version             : hbase-1.2.0-cdh5.12.1
bds-database-install: BDSQL version             : 3.2.1
bds-database-install: BDSQL install date        : Mon Nov 13 13:59:09 2017
bds-database-install: bd_cell version           : bd_cell-12.1.2.0.100_LINUX.X64_171109.1-1.x86_64
bds-database-install: cp2hadoop kit version     : orahivedp-3.2.1
bds-database-install: ohsh kit version          : ohsh-1.3.1
bds-database-install: cell config dir           : /etc/oracle/cell/network-config
bds-database-install: hybrid cell model         : false
bds-database-install: cell network(s)           : 192.168.254.5/27
bds-database-install: allow multiple subnets    : _skgxp_ant_options=1
bds-database-install: use UDP protocol          : _skgxp_dynamic_protocol=2
bds-database-install: cellaffinity.ora file     : missing
bds-database-install: listener end point        : EXTPROC1521
bds-database-install: installing JDK            : jdk1.8.0_151
bds-database-install: action                    : setup
bds-database-setup: validating 192.168.254.4/27 against network interfaces
bds-database-setup: trying to ping cluster nodes from 10.0.2.15
bds-database-setup: response fail from 192.168.254.4
bds-database-setup: response fail from 192.168.254.2
bds-database-setup: response fail from 192.168.254.3
bds-database-setup: trying to ping cluster nodes from 192.168.254.5
bds-database-setup: response ok from 192.168.254.4
bds-database-setup: response ok from 192.168.254.2
bds-database-setup: response ok from 192.168.254.3
bds-database-setup: ping succeeded on all nodes, using 192.168.254.5/27 at eth1 instead
bds-database-setup: installing cluster configuration files
bds-database-setup: unpacking hadoop-2.6.0-cdh5.12.1.tar.gz
bds-database-setup: unpacking hadoop-2.6.0-nativelib-ol6.tar.gz
bds-database-setup: unpacking hive-1.1.0-cdh5.12.1.tar.gz
bds-database-setup: unpacking hbase-1.2.0-cdh5.12.1.tar.gz
bds-database-setup: creating database objects
bds-database-setup: mta will be setup
bds-database-setup: creating /u03/app/masha/12.1.0/dbhome_mashadb/hs/admin/initbds_mashadb_clust0601bda14vm.ora
bds-database-setup: mta shutdown bds_mashadb_clust0601bda14vm
bds-database-setup: removing existing mta parameter settings
bds-database-setup: setting performance parameters for mta
bds-database-setup: setting listener_address to EXTPROC1521
bds-database-setup: starting extproc bds_mashadb_clust0601bda14vm
bds-database-setup: waiting upto 100 seconds for extproc to register with listener
....................ok
bds-database-setup: patching view LOADER_DIR_OBJS
bds-database-setup: creating mta dblinks
bds-database-setup: installing cp2hadoop
bds-database-setup: installing ohsh
bds-database-setup: reconfiguring database instance mashadb
bds-database-setup: adding parameter _bigdata_external_table=true
bds-database-setup: setup cell contiguration
bds-database-setup: cellinit.ora already has the configured ip address
bds-database-setup: cellinit.ora already enabled with UDP protocol
bds-database-setup: celliniteth.ora already has the configured ip address
bds-database-setup: celliniteth.ora already enabled with UDP protocol
bds-database-setup: cellaffinity.ora already disabled
bds-database-setup: no database restart needed

bds-database-setup: activation zip file created: clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com-clust0601bda14vm04.vm.oracle.com.zip

# /u03/app/masha/12.1.0/dbhome_mashadb/BDSJaguar-3.2.1/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com/clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com-clust0601bda14vm04.vm.oracle.com.zip

bds-database-setup: copy this file to root@clust0601bda14vm03.vm.oracle.com:/opt/oracle/DM/databases/conf
bds-database-setup: and run:

./jaguar databaseack

bds-database-setup: configuration successful for cluster clust0601bda14vm

bds-database-setup: log files in /u03/app/masha/12.1.0/dbhome_mashadb/install
bds-database-setup: bds-database-install-10657-* files for more detailed info
bds-database-setup: full log in bds-database-install-10657-main-script.log

rootスクリプトの実行による出力は次のとおりです。

[root@clust0601bda14vm04 ~]# /u03/app/masha/12.1.0/dbhome_mashadb/install/bds-database-install-10657-root-script-clust0601bda14vm.sh
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for 192.168.254.4 from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for 192.168.254.2 from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for 192.168.254.3 from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for clust0601bda14vm03.vm.oracle.com from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for clust0601bda14vm01.vm.oracle.com from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for clust0601bda14vm02.vm.oracle.com from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for clust0601bda14vm03 from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for clust0601bda14vm01 from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: removing existing entries for clust0601bda14vm02 from /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: added entry 192.168.254.4  clust0601bda14vm03.vm.oracle.com  clust0601bda14vm03 to /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: added entry 192.168.254.2  clust0601bda14vm01.vm.oracle.com  clust0601bda14vm01 to /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: added entry 192.168.254.3  clust0601bda14vm02.vm.oracle.com  clust0601bda14vm02 to /etc/hosts
bds-database-install-10657-root-script-clust0601bda14vm.sh: clust0601bda14vm: root script finished successfully

bds-database-install.shによって生成されたzipファイルをHadoopクラスタ管理サーバーにコピーします。このzipファイルには、データベース認証の設定を完了するために必要な.ackkeyファイルが含まれています。

[masha@clust0601bda14vm04 clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com]$ scp clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com-clust0601bda14vm04.vm.oracle.com.zip root@clust0601bda14vm03.vm.oracle.com:/opt/oracle/DM/databases/conf
root@clust0601bda14vm03.vm.oracle.com's password:
clust0601bda14vm-3-clust0601bda14vm03.vm.oracle.com-clust0601bda14vm04.vm.oracle.com.zip           100%  789     0.8KB/s   00:00

Hadoopクラスタ管理サーバーのrootとして、Jaguarのデータベース確認応答操作を実行します。これで、インストールが完了します。

BigDataSQL: Oracle Big Data SQL 3.2.1.
BigDataSQL: Starting execution on: Mon Nov 13 14:26:37 2017.
BigDataSQL:          in directory: /root/BDSJaguar.
BigDataSQL:          and hostname: clust0601bda14vm03.vm.oracle.com.
BigDataSQL: Verifying configuration parameters...
BigDataSQL: Starting server...
BigDataSQL: API protocol: http.
BigDataSQL: API port: 7180.
BigDataSQL: Waiting for management server to respond...
BigDataSQL: WARNING: If there are services in the stale state, they will be restarted !!!.

Cloudera Manager user: admin
Password:

BigDataSQL: Authentication succeeded.
BigDataSQL: API version: 17.
BigDataSQL: Cluster type: BDA.
BigDataSQL: Cluster name: clust0601bda14vm.
BigDataSQL: Cluster version: CDH5.
BigDataSQL: Service: BIGDATASQL.
BigDataSQL: Verifying service configuration..
BigDataSQL: Connection type: Ethernet.
BigDataSQL: Initialization completed..
BigDataSQL: Starting deployment server..
BigDataSQL: Database acknowledge..
BigDataSQL: Deployment server listening
BigDataSQL: Refreshing Big Data SQL database connections..
BigDataSQL: Starting bigdatasql service..
BigDataSQL: Setting database key for Big Data SQL..
BigDataSQL: Restarting stale services..
BigDataSQL: Restarting Cloudera Management service..

Big Data SQL setup finished !!!
run bdschecksw tool on database node for sanity verification

BigDataSQL: DATABASEACK workflow completed.

例2: HDPクラスタでのインストール

この例では、Hadoop側のインストールをHDPシステムで実行しています。データベース認証が有効になっているときにリクエスト・キーが生成されなかった場合に何が起こるかを示すために、意図的にインストール操作から--requestdbパラメータを除外します。これは、例の後半で修正されています。

[root@clust42bda07-adm BDSJaguar]# ./jaguar install
BigDataSQL: =======================================================================.
BigDataSQL: Oracle Big Data SQL 3.2.1.
BigDataSQL: Starting execution on: Mon Nov 13 12:41:05 2017.
BigDataSQL:          in directory: /root/BDSJaguar.
BigDataSQL:          and hostname: clust42bda07-adm.us.oracle.com.
BigDataSQL: Verifying configuration parameters...
BigDataSQL: Starting server...
BigDataSQL: API protocol: http.
BigDataSQL: API port: 8080.
BigDataSQL: Waiting for management server to respond...
BigDataSQL: WARNING: If there are services in the stale state, they will be restarted !!!.

Ambari user: admin
Password:

BigDataSQL: Authentication succeeded.
BigDataSQL: API version: 1.
BigDataSQL: Cluster type: HDP.
BigDataSQL: Cluster name: afghhdp.
BigDataSQL: Cluster version: HDP-2.6.
BigDataSQL: Service: BIGDATASQL.
BigDataSQL: Verifying service configuration...
BigDataSQL: Connection type: Ethernet.
BigDataSQL: Initialization completed..
BigDataSQL: Copying Stack to Ambari..
BigDataSQL: Restarting management server...
BigDataSQL: Waiting for management server to respond...
BigDataSQL: Starting deployment server..
BigDataSQL: Deployment server listening
BigDataSQL: Analyzing cluster ....
BigDataSQL: Checking for Big Data SQL requirements..
BigDataSQL: Preparing installation..
BigDataSQL: Installing Big Data SQL agents..
BigDataSQL: Installing Big Data SQL servers..
BigDataSQL: Starting bigdatasql service.
BigDataSQL: Restarting stale services..
BigDataSQL: Starting hdfs service.
BigDataSQL: Starting yarn service.
BigDataSQL: Starting mapreduce2 service.
BigDataSQL: Starting hbase service.
BigDataSQL: Big Data SQL task completed..
BigDataSQL: Creating database side bundle..
BigDataSQL: Creating bundle file.
BigDataSQL: Bundle file created: /root/BDSJaguar/db-bundles/bds-3.2.1-db-afghhdp-171113.1241.zip.
BigDataSQL: WARNING: Database authentication is enabled, you will need a reqkey file for set it up..
BigDataSQL:          Ignore this warning if you already have one or if your database already has its key,.
BigDataSQL:          otherwise, use './jaguar --requestdb <db name> databasereq' for create one..
BigDataSQL: INSTALL workflow completed.

データベース認証が有効になっていましたがインストール操作でキーがリクエストされず、インストールを実行するlaicadbデータベースについて以前にキーがリクエストされたこともありません。これを修正するには、Jaguarのdatabasereq操作を呼び出して、laicadbのリクエスト・キーを作成します。

[root@clust42bda07-adm BDSJaguar]# ./jaguar --requestdb laicadb databasereq
BigDataSQL: =======================================================================.
BigDataSQL: Oracle Big Data SQL 3.2.1.
BigDataSQL: Starting execution on: Mon Nov 13 12:56:39 2017.
BigDataSQL:          in directory: /root/BDSJaguar.
BigDataSQL:          and hostname: clust42bda07-adm.us.oracle.com.
BigDataSQL: Verifying configuration parameters...
BigDataSQL: Starting server...
BigDataSQL: API protocol: http.
BigDataSQL: API port: 8080.
BigDataSQL: Waiting for management server to respond...
BigDataSQL: WARNING: If there are services in the stale state, they will be restarted !!!.

Ambari user: admin
Password:

BigDataSQL: Authentication succeeded.
BigDataSQL: API version: 1.
BigDataSQL: Cluster type: HDP.
BigDataSQL: Cluster name: afghhdp.
BigDataSQL: Cluster version: HDP-2.6.
BigDataSQL: Service: BIGDATASQL.
BigDataSQL: Verifying service configuration...
BigDataSQL: Connection type: Ethernet.
BigDataSQL: Initialization completed..
BigDataSQL: Starting deployment server..
BigDataSQL: Deployment server listening
BigDataSQL: Requiring database keys only..
BigDataSQL: reqkey file created: /root/BDSJaguar/dbkeys/laicadb.reqkey.
BigDataSQL: DATABASEREQ workflow completed.

データベース側のインストール・バンドルおよび.reqkeyファイルを用意できたため、その両方をデータベース・ノードにコピーします。

[root@clust42bda07-adm BDSJaguar]# scp /root/BDSJaguar/db-bundles/bds-3.2.1-db-afghhdp-171113.1241.zip laica@clust42bda05-adm:/home/laica
laica@clust42bda05-adm's password:
bds-3.2.1-db-afghhdp-171113.1241.zip                                                            100%  604MB 112.0MB/s   00:05
[root@clust42bda07-adm BDSJaguar]# scp /root/BDSJaguar/dbkeys/laicadb.reqkey laica@clust42bda05-adm:/home/laica                     laica@clust42bda05-adm's password:
laicadb.reqkey                                                                                  100%  253   453.7KB/s   00:00

次に、バンドルを解凍し、実行ファイルを実行し、実行ファイルによって作成されるインストール・ディレクトリにリクエスト・キーをコピーします。

[laica@clust42bda05-adm ~]$ unzip bds-3.2.1-db-afghhdp-171113.1241.zip
Archive:  bds-3.2.1-db-afghhdp-171113.1241.zip
  inflating: bds-3.2.1-db-afghhdp-171113.1241.run
[laica@clust42bda05-adm ~]$ ./bds-3.2.1-db-afghhdp-171113.1241.run
bds-3.2.1-db-afghhdp-171113.1241.run: platform is               : Linux
bds-3.2.1-db-afghhdp-171113.1241.run: script started at         : Mon Nov 13 15:03:19 CST 2017
bds-3.2.1-db-afghhdp-171113.1241.run: running location          : /home/laica
bds-3.2.1-db-afghhdp-171113.1241.run: ORACLE_SID                : laicadb
bds-3.2.1-db-afghhdp-171113.1241.run: ORACLE_HOME               : /u03/app/laica/12.1.0/dbhome_laicadb
bds-3.2.1-db-afghhdp-171113.1241.run: install directory         : /u03/app/laica/12.1.0/dbhome_laicadb/BDSJaguar-3.2.1/afghhdp-2-clust42bda07-adm.us.oracle.com
bds-3.2.1-db-afghhdp-171113.1241.run: extracting...
bds-3.2.1-db-afghhdp-171113.1241.run: installer extracted successfully

cd $ORACLE_HOME/BDSJaguar-3.2.1/afghhdp-2-clust42bda07-adm.us.oracle.com

bds-3.2.1-db-afghhdp-171113.1241.run: for setup Big Data SQL on this database instance
[laica@clust42bda05-adm ~]$ mv laicadb.reqkey $ORACLE_HOME/BDSJaguar-3.2.1/afghhdp-2-clust42bda07-adm.us.oracle.com

インストール・ディレクトリに移動し、データベース側のインストール・ユーティリティ(bds-database-install.sh)を実行します。

[laica@clust42bda05-adm ~]$ cd $ORACLE_HOME/BDSJaguar-3.2.1/afghhdp-2-clust42bda07-adm.us.oracle.com
[laica@clust42bda05-adm afghhdp-2-clust42bda07-adm.us.oracle.com]$ ./bds-database-install.sh --install
bds-database-install: platform is               : Linux
bds-database-install: script started at         : Mon Nov 13 15:04:54 CST 2017
bds-database-install: running location          : /u03/app/laica/12.1.0/dbhome_laicadb/BDSJaguar-3.2.1/afghhdp-2-clust42bda07-adm.us.oracle.com
bds-database-install: ORACLE_SID                : laicadb
bds-database-install: ORACLE_HOME               : /u03/app/laica/12.1.0/dbhome_laicadb
bds-database-install: configuration spfile      : spfilelaicadb.ora
bds-database-install: Grid home                 : /u03/app/12.1.0/grid
bds-database-install: db resource               : laicadb
bds-database-install: crs resource              : ora.laicadb.db
bds-database-install: database type             : SINGLE
bds-database-install: cardinality               : 1
bds-database-install: mta extproc sid           : bds_laicadb_afghhdp
bds-database-install: use of crsctl             : true
bds-database-install: cluster type              : hdp
bds-database-install: connection type           : Ethernet
bds-database-install: cluster name              : afghhdp
bds-database-install: dictionary cluster name   : afghhdp
bds-database-install: Hadoop version            : hadoop-2.7.3.2.6.3.0-235
bds-database-install: Hive version              : apache-hive-1.2.1000.2.6.3.0-235-bin
bds-database-install: HBase version             : hbase-1.1.2.2.6.3.0-235
bds-database-install: BDSQL version             : 3.2.1
bds-database-install: BDSQL install date        : Mon Nov 13 12:53:29 2017
bds-database-install: bd_cell version           : bd_cell-12.1.2.0.100_LINUX.X64_171109.1-1.x86_64
bds-database-install: cp2hadoop kit version     : orahivedp-3.2.1
bds-database-install: ohsh kit version          : ohsh-1.3.1
bds-database-install: cell config dir           : /etc/oracle/cell/network-config
bds-database-install: hybrid cell model         : false
bds-database-install: cell network(s)           : 10.128.18.35/21
bds-database-install: allow multiple subnets    : _skgxp_ant_options=1
bds-database-install: use UDP protocol          : _skgxp_dynamic_protocol=2
bds-database-install: cellaffinity.ora file     : missing
bds-database-install: listener end point        : EXTPROC1521
bds-database-install: installing JDK            : jdk1.8.0_151
bds-database-install: action                    : setup
bds-database-setup: only one network interface detected, 10.128.18.35/21 at eth0
bds-database-setup: ping to cluster nodes
bds-database-setup: response ok from 10.128.18.36
bds-database-setup: response ok from 10.128.20.189
bds-database-setup: installing cluster configuration files
bds-database-setup: unpacking hadoop-2.7.3.2.6.3.0-235.tar.gz
bds-database-setup: unpacking hadoop-2.7.0-nativelib-ol6.tar.gz
bds-database-setup: unpacking apache-hive-1.2.1000.2.6.3.0-235-bin.tar.gz
bds-database-setup: unpacking hbase-1.1.2.2.6.3.0-235.tar.gz
bds-database-setup: creating database objects
bds-database-setup: mta will be setup
bds-database-setup: creating /u03/app/laica/12.1.0/dbhome_laicadb/hs/admin/initbds_laicadb_afghhdp.ora
bds-database-setup: mta shutdown bds_laicadb_afghhdp
bds-database-setup: removing existing mta parameter settings
bds-database-setup: stopping crs resource bds_laicadb_afghhdp
bds-database-setup: deleting crs resource bds_laicadb_afghhdp
bds-database-setup: registering crs resource bds_laicadb_afghhdp
bds-database-setup: using dependency db resource of laicadb
bds-database-setup: starting crs resource bds_laicadb_afghhdp
bds-database-setup: patching view LOADER_DIR_OBJS
bds-database-setup: creating mta dblinks
bds-database-setup: installing cp2hadoop
bds-database-setup: installing ohsh
bds-database-setup: setup cell contiguration
bds-database-setup: cellinit.ora already has the configured ip address
bds-database-setup: cellinit.ora already enabled with UDP protocol
bds-database-setup: celliniteth.ora already has the configured ip address
bds-database-setup: celliniteth.ora already enabled with UDP protocol
bds-database-setup: cellaffinity.ora already disabled
bds-database-setup: no database restart needed

bds-database-setup: activation zip file created: afghhdp-2-clust42bda07-adm.us.oracle.com-clust42bda05-adm.us.oracle.com.zip

# /u03/app/laica/12.1.0/dbhome_laicadb/BDSJaguar-3.2.1/afghhdp-2-clust42bda07-adm.us.oracle.com/afghhdp-2-clust42bda07-adm.us.oracle.com-clust42bda05-adm.us.oracle.com.zip

bds-database-setup: copy this file to root@clust42bda07-adm.us.oracle.com:/opt/oracle/DM/databases/conf
bds-database-setup: and run:

./jaguar databaseack

bds-database-setup: configuration successful for cluster afghhdp

bds-database-setup: log files in /u03/app/laica/12.1.0/dbhome_laicadb/install
bds-database-setup: bds-database-install-29088-* files for more detailed info
bds-database-setup: full log in bds-database-install-29088-main-script.log

インストール操作によって作成されるzipファイルには、データベース認証設定を完了するために必要な.ackkeyファイルが含まれます。このzipファイルをHadoopクラスタ管理サーバーにコピーします。

[laica@clust42bda05-adm afghhdp-2-clust42bda07-adm.us.oracle.com]$ scp afghhdp-2-clust42bda07-adm.us.oracle.com-clust42bda05-adm.us.oracle.com.zip root@clust42bda07-adm.us.oracle.com:/opt/oracle/DM/databases/conf
root@clust42bda07-adm.us.oracle.com's password:
afghhdp-2-clust42bda07-adm.us.oracle.com-clust42bda05-adm.us.oracle.com.zip                       100%  739     0.7KB/s   00:00

Hadoop側でrootとして、Jaguarのデータベース確認応答操作を実行します。

[root@clust42bda07-adm BDSJaguar]# ./jaguar databaseack
BigDataSQL: =======================================================================.
BigDataSQL: Oracle Big Data SQL 3.2.1.
BigDataSQL: Starting execution on: Mon Nov 13 13:08:43 2017.
BigDataSQL:          in directory: /root/BDSJaguar.
BigDataSQL:          and hostname: clust42bda07-adm.us.oracle.com.
BigDataSQL: Verifying configuration parameters...
BigDataSQL: Starting server...
BigDataSQL: API protocol: http.
BigDataSQL: API port: 8080.
BigDataSQL: Waiting for management server to respond...
BigDataSQL: WARNING: If there are services in the stale state, they will be restarted !!!.

Ambari user: admin
Password:

BigDataSQL: Authentication succeeded.
BigDataSQL: API version: 1.
BigDataSQL: Cluster type: HDP.
BigDataSQL: Cluster name: afghhdp.
BigDataSQL: Cluster version: HDP-2.6.
BigDataSQL: Service: BIGDATASQL.
BigDataSQL: Verifying service configuration...
BigDataSQL: Connection type: Ethernet.
BigDataSQL: Initialization completed..
BigDataSQL: Starting deployment server..
BigDataSQL: Database acknowledge..
BigDataSQL: Deployment server listening
BigDataSQL: Refreshing Big Data SQL database connections..
BigDataSQL: Starting bigdatasql service.
BigDataSQL: Setting database key for Big Data SQL..
BigDataSQL: Restarting stale services..
BigDataSQL: Starting hdfs service.
BigDataSQL: Starting yarn service.
BigDataSQL: Starting mapreduce2 service.
BigDataSQL: Starting hbase service.

Big Data SQL setup finished !!!
run bdschecksw tool on database node for sanity verification

BigDataSQL: DATABASEACK workflow completed.