[bt-devel] clucene crash when searching

[Martin Gruner]

Hi Eeli,

this should not happen. In CSwordModuleInfo, I use this code to turn off the 
use of English stop words:

	// do not use any stop words
	const TCHAR* stop_words[]  = { NULL };
	lucene::analysis::standard::StandardAnalyzer an( stop_words );
	QString index = getModuleStandardIndexLocation();

This means that "and", "or" etc. should be indexed and also included in the 
search.

mg

On Saturday 15 November 2008 09:09:08 Eeli Kaikkonen wrote:
> Martin Gruner wrote:
> > Hi Eeli,
> >
> > I don't know about this problem and I cannot look at this presently.
> > Please try to find out yourself, if you have the time for it.
> >
> > mg
> >
> > On Saturday 25 October 2008 12:31:01 Eeli Kaikkonen wrote:
> >> clucene crashes when I try to search in ESV with either or both the
> >> words "and" and "or" but not any other words with them. If I add other
> >> words it doesn't crash. I got the attached backtrace when it happened
> >> first time, consecutive repeats gave useless backtraces.
>
> I noticed that BT doesn't find small English words like and, not, or...
> They are apparently disabled in clucene indexing/searching. I find it a
> bad thing. First, Bible is a bit different from other texts when
> searching. People might want to find exact words, not just "meaningful"
> words. Second, if this is used for all modules it might cause unwanted
> results for other languages. Is there a way to use a "bare" indexing
> which takes all words as they are? would it cause any trouble with English?
>
> These unindexed words when used in search text without other words seem
> to cause this crash.
>
> --Eeli Kaikkonen
>
> _______________________________________________
> bt-devel mailing list
> bt-devel at crosswire.org
> http://www.crosswire.org/mailman/listinfo/bt-devel