T
-
public class SpatialJavaPairDStream<K,V>
extends <any>
This class represents a spatially enabled DStream. A SpatialJavaPairDStream encapsulates an existing JavaPairDStream and adds spatial transformations and functions.
Spatial information is extracted from the source DStream using an implementation of SparkRecordInfoProvider
provided by the user just like it is done with SpatialJavaRDD. The SparkRecordInfoProvider is expected to return the geometry of spatial records.
Modifier and Type | Method and Description |
---|---|
SpatialTransformationContext<<any>> |
createSpatialTransformationContext()
Creates an instance of
SpatialTransformationContext |
SpatialTransformationContext<<any>> |
createSpatialTransformationContext(SpatialOperationConfig spatialOperationConf)
Creates an instance of
SpatialTransformationContext associated to the given SpatialOperationConfig . |
<R> <any> |
enrich(<any> f, GeoEnricher enricher)
Associates records from the current spatial DStream to spatial features using an instance of
GeoEnricher |
SpatialJavaPairDStream<K,V> |
filter(<any> f, SpatialOperationConfig spatialOpConf)
Performs a filter transformation.
|
<U> <any> |
flatMap(<any> fmFun, SpatialOperationConfig spatialOpConf)
Returns a new DStream by first spatially filtering the stream elements using the spatial operation given by spatialOpConf, then a flattening function is applied to all the remaining elements.
|
static <K,V> SpatialJavaPairDStream<K,V> |
fromJavaPairDStream(<any> stream, SparkRecordInfoProvider<<any>> recordInfoProvider, java.lang.Class<K> keyType, java.lang.Class<V> valType)
Creates a new spatial pair DStream from an existing JavaPairDStream
|
java.lang.Class<K> |
getKeyType()
Gets the type of the RDD's keys
|
SparkRecordInfoProvider<<any>> |
getRecordInfoProvider()
Gets the RDD's
SparkRecordInfoProvider instance |
java.lang.Class<V> |
getValueType()
Gets the type of the RDD's values
|
<any> |
nearestNeighbors(<any> f, int k, SpatialOperationConfig spatialOpConf)
Returns a DStream containing one single element with the k elements which are closest to the given query window
|
public SpatialTransformationContext<<any>> createSpatialTransformationContext()
SpatialTransformationContext
SpatialTransformationContext
public SpatialTransformationContext<<any>> createSpatialTransformationContext(SpatialOperationConfig spatialOperationConf)
SpatialTransformationContext
associated to the given SpatialOperationConfig
.spatialOperationConf
- a spatial operation used to filter recordsSpatialTransformationContext
public <R> <any> enrich(<any> f, GeoEnricher enricher)
GeoEnricher
f
- a lambda function which is called for each record from the spatial DStream and its associated spatial features if any.enricher
- a component used to associate a geometry to spatial features from different spatial data layerspublic SpatialJavaPairDStream<K,V> filter(<any> f, SpatialOperationConfig spatialOpConf)
SpatialOperationConfig
.f
- lambda function to further filtering recordsspatialOpConf
- spatial criteria used for spatial filteringpublic <U> <any> flatMap(<any> fmFun, SpatialOperationConfig spatialOpConf)
m
- a function to apply to each elementspatialOpConf
- a spatial operation used to filter recordspublic static <K,V> SpatialJavaPairDStream<K,V> fromJavaPairDStream(<any> stream, SparkRecordInfoProvider<<any>> recordInfoProvider, java.lang.Class<K> keyType, java.lang.Class<V> valType)
stream
- the source streamrecordInfoProvider
- an instance of SparkRecordInfoProvider
used to extract spatial information from the stream's keys and valueskeyType
- the type of the source stream keysvalType
- the type of the source stream valuespublic java.lang.Class<K> getKeyType()
public SparkRecordInfoProvider<<any>> getRecordInfoProvider()
SparkRecordInfoProvider
instanceSparkRecordInfoProvider
instancepublic java.lang.Class<V> getValueType()
public <any> nearestNeighbors(<any> f, int k, SpatialOperationConfig spatialOpConf)
qryWindow
- a geometry from where the nearest neighbors will be calculatedk
- the number of neighborstol
- the tolerance usedCopyright © 2017, 2019 Oracle and/or its affiliates. All Rights Reserved.