com.oracle.bmc.hdfs.store

Class BmcReadAheadFSInputStream

java.lang.Object

java.io.InputStream

org.apache.hadoop.fs.FSInputStream

com.oracle.bmc.hdfs.store.BmcFSInputStream

com.oracle.bmc.hdfs.store.BmcReadAheadFSInputStream

All Implemented Interfaces:

Closeable, AutoCloseable, PositionedReadable, Seekable

public class BmcReadAheadFSInputStream
extends BmcFSInputStream

FSInputStream implementation that reads ahead to cache chunks of data. Like in-memory, but memory usage is limited making it suitable for all files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BmcReadAheadFSInputStream.ParquetFooterInfo Parquet caching.

Field Summary

Fields inherited from class com.oracle.bmc.hdfs.store.BmcFSInputStream

closed, currentPosition, objectStorage, readMaxRetries, requestBuilder, retryMetricsCollector, retryPolicy, sourceInputStream, statistics, status

Constructor Summary

Constructors

Constructor and Description
BmcReadAheadFSInputStream(com.oracle.bmc.objectstorage.ObjectStorage objectStorage, FileStatus status, Supplier<com.oracle.bmc.objectstorage.requests.GetObjectRequest.Builder> requestBuilder, int readMaxRetries, FileSystem.Statistics statistics, int ociReadAheadBlockSize, com.google.common.cache.Cache<String,BmcReadAheadFSInputStream.ParquetFooterInfo> parquetCache, RetryMetricsCollector retryMetricsCollector, boolean firstReadOptimizationForTTFBEnabled, boolean parquetCacheEnabled)
BmcReadAheadFSInputStream(com.oracle.bmc.objectstorage.ObjectStorage objectStorage, FileStatus status, Supplier<com.oracle.bmc.objectstorage.requests.GetObjectRequest.Builder> requestBuilder, int readMaxRetries, FileSystem.Statistics statistics, int ociReadAheadBlockSize, String parquetCacheString, RetryMetricsCollector retryMetricsCollector, boolean firstReadOptimizationForTTFBEnabled, boolean parquetCacheEnabled)

Method Summary

Modifier and Type	Method and Description
void	close()
protected long	doSeek(long pos) Perform the requested seek operation.
int	read()
int	read(byte[] buffer, int offset, int length)
int	read(long position, byte[] buffer, int offset, int length)
void	readFully(long position, byte[] buffer)
void	readFully(long position, byte[] buffer, int offset, int length)
boolean	seekToNewSource(long targetPos) There are no new sources, this method always returns false.
String	toString()

Methods inherited from class com.oracle.bmc.hdfs.store.BmcFSInputStream

available, checkNotClosed, getPos, getSourceInputStream, getStatistics, readAllBytes, readAllBytes, retryPolicy, seek, setSourceInputStream, validateState, wrap

Methods inherited from class org.apache.hadoop.fs.FSInputStream

validatePositionedReadArgs

Methods inherited from class java.io.InputStream

mark, markSupported, read, reset, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.fs.PositionedReadable

maxReadSizeForVectorReads, minSeekForVectorReads, readVectored

Constructor Detail

BmcReadAheadFSInputStream

public BmcReadAheadFSInputStream(com.oracle.bmc.objectstorage.ObjectStorage objectStorage,
                                 FileStatus status,
                                 Supplier<com.oracle.bmc.objectstorage.requests.GetObjectRequest.Builder> requestBuilder,
                                 int readMaxRetries,
                                 FileSystem.Statistics statistics,
                                 int ociReadAheadBlockSize,
                                 com.google.common.cache.Cache<String,BmcReadAheadFSInputStream.ParquetFooterInfo> parquetCache,
                                 RetryMetricsCollector retryMetricsCollector,
                                 boolean firstReadOptimizationForTTFBEnabled,
                                 boolean parquetCacheEnabled)

BmcReadAheadFSInputStream

public BmcReadAheadFSInputStream(com.oracle.bmc.objectstorage.ObjectStorage objectStorage,
                                 FileStatus status,
                                 Supplier<com.oracle.bmc.objectstorage.requests.GetObjectRequest.Builder> requestBuilder,
                                 int readMaxRetries,
                                 FileSystem.Statistics statistics,
                                 int ociReadAheadBlockSize,
                                 String parquetCacheString,
                                 RetryMetricsCollector retryMetricsCollector,
                                 boolean firstReadOptimizationForTTFBEnabled,
                                 boolean parquetCacheEnabled)

Method Detail

read

public int read()
         throws IOException

Overrides:

read in class BmcFSInputStream

Throws:

IOException

read

public int read(long position,
                byte[] buffer,
                int offset,
                int length)
         throws IOException

Specified by:

read in interface PositionedReadable

Overrides:

read in class FSInputStream

Throws:

IOException

read

public int read(byte[] buffer,
                int offset,
                int length)
         throws IOException

Overrides:

read in class BmcFSInputStream

Throws:

IOException

readFully

public void readFully(long position,
                      byte[] buffer)
               throws IOException

Specified by:

readFully in interface PositionedReadable

Overrides:

readFully in class FSInputStream

Throws:

IOException

readFully

public void readFully(long position,
                      byte[] buffer,
                      int offset,
                      int length)
               throws IOException

Specified by:

readFully in interface PositionedReadable

Overrides:

readFully in class FSInputStream

Throws:

IOException

doSeek

protected long doSeek(long pos)
               throws IOException

Description copied from class: BmcFSInputStream

Perform the requested seek operation. Note, if the subclass changes the input stream or closes it, a new one must be provided and set using BmcFSInputStream.setSourceInputStream(InputStream) before returning. The input stream that was originally created (and wrapped by BmcFSInputStream.wrap(InputStream) can be obtained from BmcFSInputStream.getSourceInputStream().

Specified by:

doSeek in class BmcFSInputStream

Parameters:

pos - The position to seek to.

Returns:

The new position after seeking.

Throws:

IOException - if the operation could not be completed

seekToNewSource

public boolean seekToNewSource(long targetPos)

Description copied from class: BmcFSInputStream

There are no new sources, this method always returns false.

Specified by:

seekToNewSource in interface Seekable

Overrides:

seekToNewSource in class BmcFSInputStream

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class BmcFSInputStream

Throws:

IOException

toString

public String toString()

Overrides:

toString in class FSInputStream