org.crosswire.jsword.index.lucene.analysis
Class ChineseLuceneAnalyzer

java.lang.Object
  extended by org.apache.lucene.analysis.Analyzer
      extended by org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
          extended by org.crosswire.jsword.index.lucene.analysis.ChineseLuceneAnalyzer
All Implemented Interfaces:
Closeable

public class ChineseLuceneAnalyzer
extends AbstractBookAnalyzer

Uses org.apache.lucene.analysis.cn.ChineseAnalyzer Analysis: ChineseTokenizer, ChineseFilter StopFilter, Stemming not implemented yet Note: org.apache.lucene.analysis.cn.CJKAnalyzer takes overlapping two character tokenization approach which leads to larger index size.

Author:
Sijo Cherian
See Also:
The GNU Lesser General Public License for details.

Field Summary
private  org.apache.lucene.analysis.cn.ChineseAnalyzer myAnalyzer
           
 
Fields inherited from class org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
book, doStemming, doStopWords, stopSet
 
Fields inherited from class org.apache.lucene.analysis.Analyzer
overridesTokenStreamMethod
 
Constructor Summary
ChineseLuceneAnalyzer()
           
 
Method Summary
 org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName, Reader reader)
           
 org.apache.lucene.analysis.TokenStream tokenStream(String fieldName, Reader reader)
           
 
Methods inherited from class org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
getBook, getDoStopWords, setBook, setDoStemming, setDoStopWords, setStopWords
 
Methods inherited from class org.apache.lucene.analysis.Analyzer
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setOverridesTokenStreamMethod, setPreviousTokenStream
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

myAnalyzer

private org.apache.lucene.analysis.cn.ChineseAnalyzer myAnalyzer
Constructor Detail

ChineseLuceneAnalyzer

public ChineseLuceneAnalyzer()
Method Detail

tokenStream

public final org.apache.lucene.analysis.TokenStream tokenStream(String fieldName,
                                                                Reader reader)
Specified by:
tokenStream in class org.apache.lucene.analysis.Analyzer

reusableTokenStream

public final org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName,
                                                                        Reader reader)
                                                                 throws IOException
Overrides:
reusableTokenStream in class org.apache.lucene.analysis.Analyzer
Throws:
IOException

Copyright ยจ 2003-2015