Go to main content
1/13
Contents
Title and Copyright Information
Preface
Audience
Related Documents
Conventions
Backus-Naur Form Syntax
Using This Guide With Oracle Big Data SQL Cloud Service
Changes in This Release
Installation and Configuration Changes
1
Introducing Oracle Big Data SQL
1.1
What Is Oracle Big Data SQL?
1.1.1
About Oracle External Tables
1.1.2
About the Access Drivers for Oracle Big Data SQL
1.1.3
About Smart Scan for HDFS
1.1.4
About Storage Indexes
1.1.5
About Predicate Push Down
1.1.6
About Oracle Big Data SQL Statistics
1.2
Installation
2
Using Oracle Big Data SQL for Data Access
2.1
Creating an Oracle External Table for Hive Data
2.1.1
Obtaining Information About a Hive Table
2.1.2
Using the CREATE_EXTDDL_FOR_HIVE Function
2.1.3
Using Oracle SQL Developer to Connect to Hive
2.1.4
Developing a CREATE TABLE Statement for ORACLE_HIVE
2.1.4.1
Using the Default ORACLE_HIVE Settings
2.1.4.2
Overriding the Default ORACLE_HIVE Settings
2.2
Creating an Oracle External Table for Oracle NoSQL Database
2.2.1
Creating a Hive External Table for Oracle NoSQL Database
2.2.2
Creating the Oracle Database Table for Oracle NoSQL Data
2.2.3
About Column Data Type Mappings
2.2.4
Example of Accessing Data in Oracle NoSQL Database
2.2.4.1
Creating the Oracle NoSQL Database Example Table
2.2.4.2
Creating the Example Hive Table for vehicleTable
2.2.4.3
Creating the Oracle Table for VEHICLES
2.3
Creating an Oracle External Table for Apache HBase
2.3.1
Creating a Hive External Table for HBase
2.3.2
Creating the Oracle Database Table for HBase
2.4
Creating an Oracle External Table for HDFS Files
2.4.1
Using the Default Access Parameters with ORACLE_HDFS
2.4.2
Overriding the Default ORACLE_HDFS Settings
2.4.2.1
Accessing a Delimited Text File
2.4.2.2
Accessing Avro Container Files
2.5
About the SQL CREATE TABLE Statement
2.5.1
Basic Syntax
2.5.2
About the External Table Clause
2.5.2.1
TYPE Clause
2.5.2.2
DEFAULT DIRECTORY Clause
2.5.2.3
LOCATION Clause
2.5.2.4
ORACLE_HDFS LOCATION Clause
2.5.2.5
ORACLE_HIVE LOCATION Clause
2.5.2.6
REJECT LIMIT Clause
2.5.2.7
ACCESS PARAMETERS Clause
2.6
About Data Type Conversions
2.7
Querying External Tables
2.7.1
Granting User Access
2.7.2
About Error Handling
2.7.3
About the Log Files
2.8
About Oracle Big Data SQL on the Database Server (Oracle Exadata Machine or Other)
2.8.1
About the bigdata_config Directory
2.8.2
Common Configuration Properties
2.8.2.1
bigdata.properties
2.8.2.2
bigdata-log4j.properties
2.8.3
About the Cluster Directory
2.8.4
About Permissions
3
Storing Oracle Data in Hadoop
3.1
Using Copy to Hadoop
3.1.1
What Is Copy to Hadoop?
3.1.2
Getting Started Using Copy to Hadoop
3.1.2.1
Table Access Requirements for Copy to Hadoop
3.1.3
Using Oracle Shell for Hadoop Loaders With Copy to Hadoop
3.1.3.1
Introducing Oracle Shell for Hadoop Loaders
3.1.4
Copy to Hadoop by Example
3.1.4.1
First Look: Loading an Oracle Table Into Hive and Storing the Data in Hadoop
3.1.4.2
Working With the Examples in the Copy to Hadoop Product Kit
3.1.4.2.1
Using Copy to Hadoop With the Default Copy Method
3.1.4.2.2
Using Copy to Hadoop With the Staged Copy Method
3.1.5
Querying the Data in Hive
3.1.6
About Column Mappings and Data Type Conversions
3.1.6.1
About Column Mappings
3.1.6.2
About Data Type Conversions
3.1.7
Working With Spark
3.1.8
Using Oracle SQL Developer with Copy to Hadoop
3.2
Storing Oracle Tablespaces in HDFS
3.2.1
Advantages and Limitations of Tablespaces in HDFS
3.2.2
About Tablespaces in HDFS and Data Encryption
3.2.3
Moving Tablespaces to HDFS
3.2.3.1
Using bds-copy-tbs-to-hdfs
3.2.3.2
Manually Moving Tablespaces to HDFS
3.2.4
Smart Scan for TableSpaces in HDFS
4
Oracle Big Data SQL Reference
4.1
DBMS_HADOOP PL/SQL Package
4.1.1
CREATE_EXTDDL_FOR_HIVE
4.1.1.1
Example
4.2
CREATE TABLE ACCESS PARAMETERS Clause
4.2.1
Syntax Rules for Specifying Properties
4.2.2
ORACLE_HDFS Access Parameters
4.2.2.1
Default Parameter Settings for ORACLE_HDFS
4.2.2.2
Optional Parameter Settings for ORACLE_HDFS
4.2.3
ORACLE_HIVE Access Parameters
4.2.3.1
Default Parameter Settings for ORACLE_HIVE
4.2.3.2
Optional Parameter Values for ORACLE_HIVE
4.2.4
com.oracle.bigdata.buffersize
4.2.5
com.oracle.bigdata.colmap
4.2.6
com.oracle.bigdata.datamode
4.2.7
com.oracle.bigdata.erroropt
4.2.8
com.oracle.bigdata.fields
4.2.9
com.oracle.bigdata.fileformat
4.2.10
com.oracle.bigdata.log.exec
4.2.11
com.oracle.bigdata.log.qc
4.2.12
com.oracle.bigdata.overflow
4.2.13
com.oracle.bigdata.rowformat
4.2.14
com.oracle.bigdata.tablename
4.3
Static Data Dictionary Views for Hive
4.3.1
ALL_HIVE_DATABASES
4.3.2
ALL_HIVE_TABLES
4.3.3
ALL_HIVE_COLUMNS
4.3.4
DBA_HIVE_DATABASES
4.3.5
DBA_HIVE_TABLES
4.3.6
DBA_HIVE_COLUMNS
4.3.7
USER_HIVE_DATABASES
4.3.8
USER_HIVE_TABLES
4.3.9
USER_HIVE_COLUMNS
Appendices
A
Manual Steps for Using Copy to Hadoop for Staged Copies
A.1
Generating the Data Pump Files
A.1.1
About Data Pump Format Files
A.1.2
Identifying the Target Directory
A.1.3
About the CREATE TABLE Syntax
A.2
Copying the Files to HDFS
A.3
Creating a Hive Table
A.3.1
About Hive External Tables
A.4
Example Using the Sample Schemas
A.4.1
About the Sample Data
A.4.2
Creating the EXPDIR Database Directory
A.4.3
Creating Data Pump Format Files for Customer Data
A.4.3.1
CREATE TABLE Example With a Simple SELECT Statement
A.4.3.2
CREATE TABLE Example With a More Complex SQL SELECT Statement
A.4.4
Verifying the Contents of the Data Files
A.4.5
Copying the Files into Hadoop
A.4.6
Creating a Hive External Table
B
Using Copy to Hadoop With Direct Copy
B.1
Manual Steps for Using Copy to Hadoop for Direct Copies
B.2
Copy to Hadoop Property Reference
C
Diagnostic Tips and Details
C.1
Running Diagnostics with bdschecksw
C.2
How to do a Quick Test
C.3
Oracle Big Data SQL Database Objects
C.4
Other Database-Side Artifacts
C.5
Hadoop Datanode Artifacts
C.6
Step-by-Step Process for Querying an External Table
C.7
Step-by-Step for a Hive Data Dictionary Query
C.8
Key Adminstration Tasks for Oracle Big Data SQL
C.9
Additional Java Diagnostics
C.10
Checking for Correct Oracle Big Data SQL Patches
D
Licensing Information
D.1
Oracle Big Data SQL Licensing
D.1.1
ANTLR 4.5.2
D.1.2
JLine 2.13
D.1.3
Apache Commons Exec 1.3
D.1.4
Apache Licensed Code
D.1.5
Apache License
Index
Scripting on this page enhances content navigation, but does not change the content in any way.