public class PlSqlTokenizer
extends java.lang.Object
tokens
that enable simple lexical analysis.
Use the Tokenizer
with an appripriate Tokenizer.Config
to ensure two character operators ( such as := and <=) are tokenized as
single tokens.
If a subclass of PlSqlToken is required rather than the default PlSqlToken a token factory can be registered which will create the tokens to be added to the list.
Modifier and Type | Method and Description |
---|---|
int |
getLineNumber(int offset)
Deprecated.
|
static java.util.Collection<java.lang.String> |
getTwoCharOperators() |
static PlSqlToken |
tokenize(java.io.Reader reader)
Creates a linked list of
PlSqlToken s for the given source. |
static PlSqlToken |
tokenize(java.io.Reader reader,
java.lang.Integer maxCodeTokens)
Creates a linked list of
PlSqlToken s for the given source. |
static PlSqlToken |
tokenize(java.io.Reader reader,
java.lang.Integer maxCodeTokens,
Tokenizer.TokenFactory tokenFactory,
java.lang.String... userTokens) |
static PlSqlToken |
tokenize(java.lang.String source,
java.lang.Integer maxCodeTokens,
Tokenizer.TokenFactory tokenFactory,
java.lang.String... userTokens)
Creates a linked list of
PlSqlToken s for the given source using
the given TokenFactory. |
static PlSqlToken |
tokenize(java.lang.String source,
java.lang.String... userTokens)
Creates a linked list of
PlSqlToken s for the given source. |
static PlSqlToken |
tokenize(java.lang.String source,
Tokenizer.TokenFactory tokenFactory)
Creates a linked list of
PlSqlToken s for the given source using
the given TokenFactory. |
static PlSqlToken |
tokenizeJava(java.lang.String source)
Deprecated.
|
@Deprecated public int getLineNumber(int offset)
offset
- the offset into the sourcepublic static PlSqlToken tokenize(java.lang.String source, java.lang.String... userTokens)
PlSqlToken
s for the given source.
Tokens can be strings, comments, whitespace, punctuation or alphanumerics.
See PlSqlToken
for details. The list is headed and tailed with
special marker tokens.source
- The PL/SQL source to be tokenized.userTokens
- An optional array of Strings to be considered as tokenspublic static PlSqlToken tokenize(java.lang.String source, Tokenizer.TokenFactory tokenFactory)
PlSqlToken
s for the given source using
the given TokenFactory.
Tokens can be strings, comments, whitespace, punctuation or alphanumerics.
See PlSqlToken
for details. The list is headed and tailed with
special marker tokens.source
- The PL/SQL sourcetokenFactory
- An implementation of TokenFactory that will create the
PlSqlTokenspublic static PlSqlToken tokenize(java.io.Reader reader)
PlSqlToken
s for the given source.
Tokens can be strings, comments, whitespace, punctuation or alphanumerics.
See PlSqlToken
for details. The list is headed and tailed with
special marker tokens.reader
- A Reader
providing the PL/SQL source to be tokenized.public static PlSqlToken tokenize(java.io.Reader reader, java.lang.Integer maxCodeTokens)
PlSqlToken
s for the given source.
Tokens can be strings, comments, whitespace, punctuation or alphanumerics.
See PlSqlToken
for details. The list is headed and tailed with
special marker tokens.reader
- A Reader
providing the PL/SQL source to be tokenized.maxCodeTokens
- The maximum number of code tokens to be tokenized.public static java.util.Collection<java.lang.String> getTwoCharOperators()
public static PlSqlToken tokenize(java.lang.String source, java.lang.Integer maxCodeTokens, Tokenizer.TokenFactory tokenFactory, java.lang.String... userTokens)
PlSqlToken
s for the given source using
the given TokenFactory.
Tokens can be strings, comments, whitespace, punctuation or alphanumerics.
See PlSqlToken
for details. The list is headed and tailed with
special marker tokens.source
- the PL/SQL sourcemaxCodeTokens
- The maximum number of code tokens to be tokenized.tokenFactory
- An implementation of TokenFactory that will create the
PlSqlTokensuserTokens
- An optional array of Strings to be considered as tokenspublic static PlSqlToken tokenize(java.io.Reader reader, java.lang.Integer maxCodeTokens, Tokenizer.TokenFactory tokenFactory, java.lang.String... userTokens)
@Deprecated public static PlSqlToken tokenizeJava(java.lang.String source)