oracle.javatools.db.token

Class Tokenizer

java.lang.Object

oracle.javatools.db.token.Tokenizer

public final class Tokenizer
extends java.lang.Object

A utility class for the purpose of splitting PL/SQL source into a list of tokens that enable simple lexical analysis. If a subclass of Token is required rather than the default Token a token factory can be registered which will create the tokens to be added to the list.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Tokenizer.Config Configuration object that drives the tokenization
static interface	Tokenizer.TokenFactory Token factory which will create subclass of Token if required

Constructor Summary

Constructors

Constructor and Description
Tokenizer(Tokenizer.Config config)

Method Summary

Modifier and Type	Method and Description
Token	getEndMarker()
Token	getFirst()
Token	getStartMarker()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer(Tokenizer.Config config)

Method Detail

getFirst

public final Token getFirst()

getStartMarker

public final Token getStartMarker()

getEndMarker

public final Token getEndMarker()