protected static class AbstractLexer.DefaultLexerToken extends java.lang.Object implements LexerToken
DefaultLexerToken
just implements a basic
LexerToken which stores a token and start/end offsets.Modifier and Type | Field and Description |
---|---|
protected int |
endOffset
The ending offset in the text buffer of this token.
|
protected int |
startOffset
The starting offset in the text buffer of this token.
|
protected int |
token
The token that was found.
|
Modifier | Constructor and Description |
---|---|
protected |
AbstractLexer.DefaultLexerToken() |
Modifier and Type | Method and Description |
---|---|
int |
getEndOffset()
Fetches the end offset of the token (offset relative to the original
ReadTextBuffer being lexed. |
int |
getStartOffset()
Fetches the start offset of the token (offset relative to the
original
ReadTextBuffer being lexed. |
int |
getToken()
Fetches the (language-specific) token represented by this
LexerToken . |
void |
setEndOffset(int end)
Sets the end offset for this token.
|
void |
setStartOffset(int start)
Sets the starting offset for this token.
|
void |
setToken(int token)
Set the token of this object.
|
protected int token
protected int startOffset
protected int endOffset
public int getToken()
LexerToken
. You must refer to the language-specific
Lexer that was responsible for filling this
LexerToken
instance to interpret the token.getToken
in interface LexerToken
public void setToken(int token)
token
- the token to setpublic int getStartOffset()
ReadTextBuffer
being lexed. Note that the
start offset is inclusive (compare to end offset which is
exclusive), to match the behavior in the String
class.getStartOffset
in interface LexerToken
public void setStartOffset(int start)
start
- the starting offsetpublic int getEndOffset()
ReadTextBuffer
being lexed. Note that the end offset is
exclusive (similar to end offsets in the String class.)getEndOffset
in interface LexerToken
public void setEndOffset(int end)
end
- the ending offset