oracle.hadoop.balancer.examples.invindx

Class InvertedIndex.WordUtils

java.lang.Object

oracle.hadoop.balancer.examples.invindx.InvertedIndex.WordUtils

Enclosing class:

InvertedIndex

public static class InvertedIndex.WordUtils
extends java.lang.Object

This class contains word utilities like stop-word checking. It is also a good place to add word-stemming, or map words to word Ids, for example, if we want to use integer keys instead of text keys for efficiency.

Field Summary

Fields

Modifier and Type	Field and Description
static boolean	DEFAULT_USE_STATIC_STOPWORDS
static java.lang.String	USE_STATIC_STOPWORDS

Constructor Summary

Constructors

Constructor and Description
InvertedIndex.WordUtils(org.apache.hadoop.conf.Configuration conf)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	isStopWord(java.lang.String token)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_USE_STATIC_STOPWORDS

public static boolean DEFAULT_USE_STATIC_STOPWORDS

USE_STATIC_STOPWORDS

public static java.lang.String USE_STATIC_STOPWORDS

Constructor Detail

InvertedIndex.WordUtils

public InvertedIndex.WordUtils(org.apache.hadoop.conf.Configuration conf)

Method Detail

isStopWord

public boolean isStopWord(java.lang.String token)

Returns:

true if token is a stop word