Skip navigation links
oracle.hadoop.balancer.examples.invindx
Class InvertedIndex.WordUtils
java.lang.Object
oracle.hadoop.balancer.examples.invindx.InvertedIndex.WordUtils
- Enclosing class:
- InvertedIndex
-
public static class InvertedIndex.WordUtils
- extends java.lang.Object
This class contains word utilities like stop-word checking. It is also a good place to add word-stemming, or map words to wordIds e.g. if we want to use integer keys instead of text keys for efficiency.
Method Summary |
boolean |
isStopWord(java.lang.String token)
|
Methods inherited from class java.lang.Object |
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
DEFAULT_USE_STATIC_STOPWORDS
public static boolean DEFAULT_USE_STATIC_STOPWORDS
USE_STATIC_STOPWORDS
public static java.lang.String USE_STATIC_STOPWORDS
InvertedIndex.WordUtils
public InvertedIndex.WordUtils(org.apache.hadoop.conf.Configuration conf)
isStopWord
public boolean isStopWord(java.lang.String token)
-
- Returns:
- true if token is a stop-word
Skip navigation links
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.