Skip navigation links

oracle.hadoop.balancer.examples.invindx
Class InvertedIndex.WordUtils

java.lang.Object
oracle.hadoop.balancer.examples.invindx.InvertedIndex.WordUtils

Enclosing class:

InvertedIndex

public static class InvertedIndex.WordUtils

extends java.lang.Object

This class contains word utilities like stop-word checking. It is also a good place to add word-stemming, or map words to wordIds e.g. if we want to use integer keys instead of text keys for efficiency.

Field Summary

static boolean	DEFAULT_USE_STATIC_STOPWORDS
static java.lang.String	USE_STATIC_STOPWORDS

Constructor Summary

InvertedIndex.WordUtils(org.apache.hadoop.conf.Configuration conf)

Method Summary

boolean

isStopWord(java.lang.String token)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_USE_STATIC_STOPWORDS

public static boolean DEFAULT_USE_STATIC_STOPWORDS

USE_STATIC_STOPWORDS

public static java.lang.String USE_STATIC_STOPWORDS

Constructor Detail

InvertedIndex.WordUtils

public InvertedIndex.WordUtils(org.apache.hadoop.conf.Configuration conf)

Method Detail

isStopWord

public boolean isStopWord(java.lang.String token)

Returns:

true if token is a stop-word

Skip navigation links