oracle.spatial.spark.vector.index.quadtree

Class QuadTreeDistIndex<T>

java.lang.Object

oracle.spatial.spark.vector.index.DistributedSpatialIndex<T>

oracle.spatial.spark.vector.index.quadtree.QuadTreeDistIndex<T>

Type Parameters:

T -

All Implemented Interfaces:

java.io.Serializable

public class QuadTreeDistIndex<T>
extends DistributedSpatialIndex<T>

An implementation of DistributedSpatialIndex based on a QuadTree

See Also:

Serialized Form

Field Summary

Fields inherited from class oracle.spatial.spark.vector.index.DistributedSpatialIndex

BOOTSTRAP_FILE, type

Constructor Summary

Constructors

Constructor and Description
QuadTreeDistIndex(java.lang.Class<T> type) Crates a new instance ready for an RDD of the given generic type

Method Summary

Methods

Modifier and Type	Method and Description
void	cache() Persist the index' internal RDD with the default storage level
SpatialJavaRDD<T>	filter(org.apache.spark.api.java.function.Function<T,java.lang.Boolean> filterFunc, SpatialOperationConfig spatialOpConf) Returns a new spatial RDD containing only the elements that satisfy both, the filtering function and the spatial operation
<R> org.apache.spark.api.java.JavaRDD<R>	flatMap(org.apache.spark.api.java.function.FlatMapFunction<T,R> f, SpatialOperationConfig spatialOpConf) Returns a new RDD by first spatially filtering the RDD elements using the spatial operation given by spatialOpConf, then a function is applied to all the remaining elements.
protected void	index(org.apache.spark.api.java.JavaSparkContext sc, SpatialJavaRDD<T> rdd, SpatialPartitioningConfiguration partConf) Spatially indexes an RDD.
<T2,R> org.apache.spark.api.java.JavaRDD<R>	join(SpatialJavaRDD<T2> rdd2, org.apache.spark.api.java.function.Function2<T,T2,R> f, SpatialOperationConfig spatialOpConf) Joins the records of the current index' data set with another spatial data set based on a spatial relationship between both data set's records
void	persist(org.apache.spark.storage.StorageLevel storageLevel) Sets the index' internal RDD's storage level to persist its values across operations after the first time it is computed.
void	read(org.apache.spark.api.java.JavaSparkContext sc, java.lang.String file) Loads a persisted index from the given path.
void	unpersist() Marks the index' internal RDD as non-persistent
void	write(org.apache.spark.api.java.JavaSparkContext sc, java.lang.String pathStr) Writes the current index to the given path

Methods inherited from class oracle.spatial.spark.vector.index.DistributedSpatialIndex

createIndex, load, save

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QuadTreeDistIndex

public QuadTreeDistIndex(java.lang.Class<T> type)

Crates a new instance ready for an RDD of the given generic type

Parameters:

type -

Method Detail

index

protected void index(org.apache.spark.api.java.JavaSparkContext sc,
                     SpatialJavaRDD<T> rdd,
                     SpatialPartitioningConfiguration partConf)

Description copied from class: DistributedSpatialIndex

Spatially indexes an RDD. This method is called by the Vecto API and is not meant to be called by users.

Specified by:

index in class DistributedSpatialIndex<T>

Parameters:

sc - an existing Spark context

rdd - a spatial RDD

partConf - the indexing and partitioning configuration

filter

public SpatialJavaRDD<T> filter(org.apache.spark.api.java.function.Function<T,java.lang.Boolean> filterFunc,
                                SpatialOperationConfig spatialOpConf)
                         throws java.lang.Exception

Description copied from class: DistributedSpatialIndex

Returns a new spatial RDD containing only the elements that satisfy both, the filtering function and the spatial operation

Specified by:

filter in class DistributedSpatialIndex<T>

Parameters:

filterFunc - a filtering function

spatialOpConf - the spatial operation configuration to spatially filter the RDD

Returns:

a new SpatialJavaRDD

Throws:

java.lang.Exception

flatMap

public <R> org.apache.spark.api.java.JavaRDD<R> flatMap(org.apache.spark.api.java.function.FlatMapFunction<T,R> f,
                                                        SpatialOperationConfig spatialOpConf)
                                                 throws java.lang.Exception

Description copied from class: DistributedSpatialIndex

Returns a new RDD by first spatially filtering the RDD elements using the spatial operation given by spatialOpConf, then a function is applied to all the remaining elements.

Specified by:

flatMap in class DistributedSpatialIndex<T>

Parameters:

f - a function to apply to each element

spatialOpConf - the spatial operation configuration to spatially filter the RDD

Returns:

a new RDD

Throws:

java.lang.Exception

join

public <T2,R> org.apache.spark.api.java.JavaRDD<R> join(SpatialJavaRDD<T2> rdd2,
                                                        org.apache.spark.api.java.function.Function2<T,T2,R> f,
                                                        SpatialOperationConfig spatialOpConf)
                                                 throws java.lang.Exception

Description copied from class: DistributedSpatialIndex

Joins the records of the current index' data set with another spatial data set based on a spatial relationship between both data set's records

Specified by:

join in class DistributedSpatialIndex<T>

Parameters:

rdd2 - a spatial RDD to join with

f - a tuple processor function which receives a tuple of records from both data sets which match the spatial join condition

spatialOpConf - a spatial operation configuration defining the spatial relationship to join records

Returns:

a new RDD

Throws:

java.lang.Exception

persist

public void persist(org.apache.spark.storage.StorageLevel storageLevel)

Description copied from class: DistributedSpatialIndex

Sets the index' internal RDD's storage level to persist its values across operations after the first time it is computed.

Specified by:

persist in class DistributedSpatialIndex<T>

unpersist

public void unpersist()

Description copied from class: DistributedSpatialIndex

Marks the index' internal RDD as non-persistent

Specified by:

unpersist in class DistributedSpatialIndex<T>

cache

public void cache()

Description copied from class: DistributedSpatialIndex

Persist the index' internal RDD with the default storage level

Specified by:

cache in class DistributedSpatialIndex<T>

write

public void write(org.apache.spark.api.java.JavaSparkContext sc,
                  java.lang.String pathStr)
           throws java.lang.Exception

Description copied from class: DistributedSpatialIndex

Writes the current index to the given path

Specified by:

write in class DistributedSpatialIndex<T>

Parameters:

sc - an existing Spark context

pathStr - a path on either, a local or distributed file system

Throws:

java.lang.Exception

read

public void read(org.apache.spark.api.java.JavaSparkContext sc,
                 java.lang.String file)
          throws java.lang.Exception

Description copied from class: DistributedSpatialIndex

Loads a persisted index from the given path. The persisted index is expected to be of the same implementation class than the current instance

Specified by:

read in class DistributedSpatialIndex<T>

Parameters:

sc - an existing Spark context

file - a path on either, a local or distributed file system

Throws:

java.lang.Exception