oracle.spatial.spark.vector.util

Class JDBCUtils

java.lang.Object

oracle.spatial.spark.vector.util.JDBCUtils

public class JDBCUtils
extends java.lang.Object

Contains utility methods for creating Spatial RDDs using the Oracle RDBMS as a source

Author:

hsaucedo

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	JDBCUtils.ConnectionSupplier Defines a template for creating a lambda function to supply a database connection

Constructor Summary

Constructors

Constructor and Description
JDBCUtils()

Method Summary

Modifier and Type	Method and Description
static SpatialJavaRDD<SparkRecordInfo>	createSpatialRDDFromQuery(JavaSparkContext sc, JDBCUtils.ConnectionSupplier getConnection, java.lang.String sql, SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider) Creates a Spatial RDD given a SQL query to a database.
static SpatialJavaRDD<SparkRecordInfo>	createSpatialRDDFromQuery(JavaSparkContext sc, JDBCUtils.ConnectionSupplier getConnection, java.lang.String sql, SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider, long rowsPerPartition) Creates a Spatial RDD given a SQL query to a database.
static SpatialJavaRDD<SparkRecordInfo>	createSpatialRDDFromTable(JavaSparkContext sc, JDBCUtils.ConnectionSupplier getConnection, java.lang.String tableName, java.util.List<java.lang.String> fields, SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider) Creates a Spatial RDD given the name of a table and the fields to be selected.
static SpatialJavaRDD<SparkRecordInfo>	createSpatialRDDFromTable(JavaSparkContext sc, JDBCUtils.ConnectionSupplier getConnection, java.lang.String tableName, java.util.List<java.lang.String> fields, SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider, long rowsPerPartition) Creates a Spatial RDD given the name of a table and the fields to be selected.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JDBCUtils

public JDBCUtils()

Method Detail

createSpatialRDDFromQuery

public static SpatialJavaRDD<SparkRecordInfo> createSpatialRDDFromQuery(JavaSparkContext sc,
                                                                        JDBCUtils.ConnectionSupplier getConnection,
                                                                        java.lang.String sql,
                                                                        SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider)
                                                                 throws java.sql.SQLException

Creates a Spatial RDD given a SQL query to a database. If recordInfoProvider is null, a default SparkRecordInfoProvider implementation will be used.

Parameters:

sc - a spark context

getConnection - a lambda function that supplies the connection to the database

sql - a SQL query which will return the content for the RDD. A spatial column is expected.

recordInfoProvider - an implementation of SparkRecordInfoProvider to customize how the row's fields are mapped to a SparkRecordInfo. If null or empty, a default implementation is used.

Returns:

a new Spatial RDD

Throws:

java.sql.SQLException

createSpatialRDDFromQuery

public static SpatialJavaRDD<SparkRecordInfo> createSpatialRDDFromQuery(JavaSparkContext sc,
                                                                        JDBCUtils.ConnectionSupplier getConnection,
                                                                        java.lang.String sql,
                                                                        SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider,
                                                                        long rowsPerPartition)
                                                                 throws java.sql.SQLException

Creates a Spatial RDD given a SQL query to a database. If recordInfoProvider is null, a default SparkRecordInfoProvider implementation will be used.

Parameters:

sc - a spark context

getConnection - a lambda function that supplies the connection to the database

sql - a SQL query which will return the content for the RDD. A spatial column is expected.

recordInfoProvider - an implementation of SparkRecordInfoProvider to customize how the row's fields are mapped to a SparkRecordInfo. If null or empty, a default implementation is used.

rowsPerPartition - the number of desired rows from the database to be stored per spark partition

Returns:

a new Spatial RDD

Throws:

java.sql.SQLException

createSpatialRDDFromTable

public static SpatialJavaRDD<SparkRecordInfo> createSpatialRDDFromTable(JavaSparkContext sc,
                                                                        JDBCUtils.ConnectionSupplier getConnection,
                                                                        java.lang.String tableName,
                                                                        java.util.List<java.lang.String> fields,
                                                                        SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider)
                                                                 throws java.sql.SQLException

Creates a Spatial RDD given the name of a table and the fields to be selected. If no fields list is provided, all the fields from the table will be selected. If recordInfoProvider is null, a default SparkRecordInfoProvider implementation will be used.

Parameters:

sc - a spark context

getConnection - a lambda function that supplies the connection to the database

tableName - the name of the table to be queried

fields - a list of the fields names to be queried. If null or empty, all the table fields are retrieved.

recordInfoProvider - an implementation of SparkRecordInfoProvider to customize how the row's fields are mapped to a SparkRecordInfo. If null or empty, a default implementation is used.

Returns:

a new Spatial RDD

Throws:

java.sql.SQLException

createSpatialRDDFromTable

public static SpatialJavaRDD<SparkRecordInfo> createSpatialRDDFromTable(JavaSparkContext sc,
                                                                        JDBCUtils.ConnectionSupplier getConnection,
                                                                        java.lang.String tableName,
                                                                        java.util.List<java.lang.String> fields,
                                                                        SparkRecordInfoProvider<java.sql.ResultSet> recordInfoProvider,
                                                                        long rowsPerPartition)
                                                                 throws java.sql.SQLException

Creates a Spatial RDD given the name of a table and the fields to be selected. If no fields list is provided, all the fields from the table will be selected. If recordInfoProvider is null, a default SparkRecordInfoProvider implementation will be used. The resulting RDD is partitioned based on the number of rows per partition parameter.

Parameters:

sc - a spark context

getConnection - a lambda function that supplies the connection to the database

tableName - the name of the table to be queried

fields - a list of the fields names to be queried. If null or empty, all the table fields are retrieved.

recordInfoProvider - an implementation of SparkRecordInfoProvider to customize how the row's fields are mapped to a SparkRecordInfo. If null or empty, a default implementation is used.

rowsPerPartition - the number of desired rows from the database to be stored per spark partition

Returns:

a new Spatial RDD

Throws:

java.sql.SQLException