[sword-devel] Soft hyphens

[DM Smith]

I don’t think they should be removed upstream except to fix errors. David classified these as multiple and useless. Regarding useless, I’m not sure that “punctuation” is such a universal language construct that it can be included in such a determination. E.g. An apostrophe is often used as a glottal stop.

I don’t think they should be removed from the OSIS file. I won’t change osis2mod to do that. The proper place to handle search problems is in the SWORD and JSword engine. Basically when an index is created the text has to be normalized for searching. When providing a search request, likewise it has to be normalized the same way. Troy has checked in a change to do that. He has also identified the need to have plain text filter be separate from a search normalizing filter.

In addition to Michael’s caution, having soft hyphens is useful to improving readability on small devices such as a phone or tablet.

DM


> On Nov 2, 2017, at 8:35 AM, Cyrille <lafricain79 at gmail.com> wrote:
> 
> 
> 
> Le 02/11/2017 à 13:25, David Haslam a écrit :
>> It is a much simpler task to remove ALL soft hyphens rather than removing
>> only the delinquent ones!
> My proposition is to remove it in the osis file maybe during the
> conversion from usfm to osis, with o2u.py. Maybe Ryan would accept to
> add this in the script, I can report a bug. Why am I not so enthusiasm
> to remove directly in the usfm files? Because I need the files for
> publication, and for publication it is very useful to have the soft hyphens.
>> - multiple soft hyphens at the same position in a word
>> - useless soft hyphens (before or after a space or punctuation mark)
>> 
>> Delinquent ones were quite a common occurrence in the Lingala source text.
>> Harmless for a printed Bible, but a potential nuisance in a digital edition.
>> 
>> We're getting there slowly.
> Yes..
>> 
>> Best regards,
>> 
>> David
>> 
>> 
>> 
>> 
>> 
>> --
>> Sent from: http://sword-dev.350566.n4.nabble.com/
>> 
>> _______________________________________________
>> sword-devel mailing list: sword-devel at crosswire.org
>> http://www.crosswire.org/mailman/listinfo/sword-devel
>> Instructions to unsubscribe/change your settings at above page
> 
> 
> 
> _______________________________________________
> sword-devel mailing list: sword-devel at crosswire.org
> http://www.crosswire.org/mailman/listinfo/sword-devel
> Instructions to unsubscribe/change your settings at above page