<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">John,<div><br></div><div>Putting this up on sword-devel, since that is a more appropriate location for the discussion to continue. This is really not about JSword, but rather about module making.</div><div><br><div>The nature of osis2mod is to retain all markup except <verse> and </verse> (or their equivalent milestoned version.) This means that the markup for a chapter is put in the module's storage for that chapter and noted in the index. In the case of the chapter that is given below, it is split into 2 parts, Verse 0 and Verse 1.</div><div>Verse 0 will get the preamble of the chapter:</div><div><chapter osisID="EpJer.1"></div><div>Verse 1 will get:</div><div></chapter></div><div>(These will have been transformed into their milestoned versions.)</div><div><br></div><div>Also, verse 2 to 72 will be "linked" to verse 1, meaning that in the index they are given the same location as verse 1.</div><div><br></div><div>So, verse 0 has chapter start content and verse 1 to 72 have chapter end content.</div><div><br></div><div>Also, osis2mod does not complain if a verse is missing. Never has, never will. It does "complain" of a verse being present that is not in the versification. Always has, always will.</div><div><br></div><div><div>That emptyvss indicates that all verses are present means exactly that: All verses are present. This is not good if the module is in fact incomplete.</div><div><br></div><div>That JSword indicates that these "empty" verses are present means that they have non-zero length in the module.</div></div><div><br></div><div>JSword is graceful in handling this. It determines that the module has content for the verse by examining the index. What Martin is trying to do is find out which books, chapters and verses should be displayed to users in pick lists. The only way this can be done at this time, by either SWORD or JSword with the module in question, is to render each verse and determine that it renders nothing. This is far too expensive an operation to consider.</div><div><br></div><div>The only way to efficiently determine scope is to examine the index for each verse and see if the length is 0. The Scope entry in the conf has been ruled out. It would have been computed using the reverse logic of emptyvss. Go through the v11n from first verse to last and rather than noting what is missing, note what is present.</div><div><br></div><div>Today, most of our frontends display pick lists based on the v11n not on the module content. It has long been confusing to end users of modules that don't contain verses in the v11n.</div><div><br></div><div>In my view, this is a module problem. It is far easier and faster to rebuild and redistribute a module. We can tell a user to upgrade to the most recent version of a module far easier than making and releasing a code change and having them get a new version of the program. When the change is a work-around for something that shouldn't be in module, I think we should avoid that. For example, the NET Bible has some bugs that should be fixed. But instead we have some special code that is essentially: if module is NET then fix such-and-so when it occurs.</div><div><br></div><div>Together in His Service,</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>DM Smith</div><div><br></div><div><br></div><div><br></div><div><div><div>On Mar 25, 2014, at 11:43 PM, John Austin <<a href="mailto:gpl.programs.info@gmail.com">gpl.programs.info@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">There has been a lot of discussion about how missing material in a v11n should be treated (the discussion of the meaning and use of Scope was part of that). Tools such as osis2mod generated warnings whenever OSIS files lacked any part of the chosen v11n. The Scope conf param was, for a time at least, the recommended method of describing what part of a v11n was covered by a module. For these reasons, many existing modules (IBT alone has at least 26 such modules) are currently encoded so as to encompass the entire v11n, returning empty-string verse content for all verses in the v11n that are not included in the module, and using the .conf Scope param to define exactly what is present in the module.<br><br>So even though current module making best practice may be different, it would be good for JSword to be graceful with modules that are encoded somewhat differently if at all possible, at least for a time. There are many modules out there, old and new, which don't contain the complete v11n, so determining book coverage is important.<br><br>-John<br><br><br><br>On 03/25/2014 08:19 PM, DM Smith wrote:<br><blockquote type="cite">Those verses exist since they are defined in the OSIS input file to<br>osis2mod. Osis2mod retains everything in its input. This is a well<br>documented behavior of osis2mod.<br><br>The end chapter markup will be put in the last verse that is in the<br>chapter, which might be verse 0.<br><br>They should use xslt to strip empty verses, chapters and books out of<br>their file into an intermediate file and give that as input to osis2mod.<br><br>Alternatively they can use <!-- ... --> to comment out huge swaths of<br>the input file.<br><br><br>-- DM<br><br>On Mar 25, 2014, at 7:48 AM, Martin Denham <<a href="mailto:mjdenham@gmail.com">mjdenham@gmail.com</a><br><<a href="mailto:mjdenham@gmail.com">mailto:mjdenham@gmail.com</a>>> wrote:<br><br><blockquote type="cite">IBT have just passed me more information regarding their handling of<br>empty verses to help clarify if this is an IBT module issue or not.<br>The following is an extract from IBT's e-mail:<br><br> Here are examples of how IBT's OSIS source defines empty verses in<br> the markup:<br><br> Empty book (Epistle of Jeremiah):<br> <div type="x-Synodal-non-canonical"__><div type="book"<br> osisID="EpJer"><chapter osisID="EpJer.1"><verse sID="EpJer.1.1-72"<br> osisID="EpJer.1.1 EpJer.1.2 EpJer.1.3 EpJer.1.4 EpJer.1.5<br> EpJer.1.6 EpJer.1.7 EpJer.1.8 EpJer.1.9 EpJer.1.10 EpJer.1.11<br> EpJer.1.12 EpJer.1.13 EpJer.1.14 EpJer.1.15 EpJer.1.16 EpJer.1.17<br> EpJer.1.18 EpJer.1.19 EpJer.1.20 EpJer.1.21 EpJer.1.22 EpJer.1.23<br> EpJer.1.24 EpJer.1.25 EpJer.1.26 EpJer.1.27 EpJer.1.28 EpJer.1.29<br> EpJer.1.30 EpJer.1.31 EpJer.1.32 EpJer.1.33 EpJer.1.34 EpJer.1.35<br> EpJer.1.36 EpJer.1.37 EpJer.1.38 EpJer.1.39 EpJer.1.40 EpJer.1.41<br> EpJer.1.42 EpJer.1.43 EpJer.1.44 EpJer.1.45 EpJer.1.46 EpJer.1.47<br> EpJer.1.48 EpJer.1.49 EpJer.1.50 EpJer.1.51 EpJer.1.52 EpJer.1.53<br> EpJer.1.54 EpJer.1.55 EpJer.1.56 EpJer.1.57 EpJer.1.58 EpJer.1.59<br> EpJer.1.60 EpJer.1.61 EpJer.1.62 EpJer.1.63 EpJer.1.64 EpJer.1.65<br> EpJer.1.66 EpJer.1.67 EpJer.1.68 EpJer.1.69 EpJer.1.70 EpJer.1.71<br> EpJer.1.72"/><verse eID="EpJer.1.1-72"/></chapter>__</div></div><br><br> I'm not sure how osis2mod handles all this when importing to the<br> module, but it works perfectly without warnings or errors. Also,<br> when the resulting module is passed to the "emptyvss" tool, it<br> passes this test without warnings.<br><br><br><br>On 25 March 2014 11:38, Martin Denham <<a href="mailto:mjdenham@gmail.com">mjdenham@gmail.com</a><br><<a href="mailto:mjdenham@gmail.com">mailto:mjdenham@gmail.com</a>>> wrote:<br><br> I am having problems getting a list of BibleBooks contained in<br> some AV modules which we know do not contain certain books. I<br> can't work out if the problem is with JSword, the modules, or<br> osis2mod.<br><br> There are 2 related problems I can see:<br><br> 1. book.contains(nonExistingVerse) returns TRUE<br> 2. book.getRawText(nonExistingVerse) returns <chapter end tag><br><br> Here is a simple test to show the problem using KAZ which has<br> Synodal v11n but does not contain any deuterocanonical books:<br><br> SwordBook kaz = (SwordBook)Books.installed().getBook("KAZ");<br> Verse esd11Verse = new Verse(kaz.getVersification(),<br> BibleBook.ESD1, 1, 1);<br> System.out.println(kaz.contains(esd11Verse));// prints: *true*<br> System.out.println(kaz.getRawText(esd11Verse));// prints:<br> *<chapter eID="gen7" osisID="1Esd.1"/>*<br> Verse esd12Verse = new Verse(kaz.getVersification(),<br> BibleBook.ESD1, 1, 2);<br> System.out.println(kaz.contains(esd12Verse));// prints: *true*<br> System.out.println(kaz.getRawText(esd12Verse));// prints:<br> *<chapter eID="gen7" osisID="1Esd.1"/>*<br><br> So how does "<chapter eID="gen7" osisID="1Esd.1"/>" get into verse<br> content unexpectedly?<br><br> It seems to me like it could be either:<br><br> 1. a module problem; but IBT say they do not add empty verse slots<br> 2. Sword osis2mod issue<br> 3. JSword issue: why is JSword returning a chapter end tag<br> instead of verse content<br><br> Any ideas what might cause this problem?<br><br> Thanks<br> Martin<br><br><br> On 11 March 2014 12:15, DM Smith <<a href="mailto:dmsmith@crosswire.org">dmsmith@crosswire.org</a><br> <<a href="mailto:dmsmith@crosswire.org">mailto:dmsmith@crosswire.org</a>>> wrote:<br><br> We haven't pushed this down into JSword. So far it is the<br> responsibility of the front-end. Chris B has made it efficient<br> to ask a Book whether it contains a Verse.<br><br> Essentially, when it comes to asking a module if it has<br> meaningful content, you want containsAny(Key verses, boolean<br> includeIntros) and containsAny(Key verses) { return<br> containsAny(verses, false); }<br><br> I think it should ignore verse 0 by default. If it doesn't<br> have verse content, then does the content really mean something?<br><br> As you have noted contains(Key) is confusing. There are a few<br> places where it means containsAny. Usually it means<br> containAll. The name, contains, was chosen early as we derived<br> from a container class where the argument was an element of<br> the container. That is, contains is supposed to mean<br> isMemberOf. Later we changed the inheritance as it wasn't an<br> "is a" relationship.<br><br> But we need to be careful of not introducing more confusion.<br><br> By the way, the list serve was holding mail for a few days.<br><br> In Him,<br> DM<br><br> On Mar 8, 2014, at 5:26 PM, Martin Denham <<a href="mailto:mjdenham@gmail.com">mjdenham@gmail.com</a><br> <<a href="mailto:mjdenham@gmail.com">mailto:mjdenham@gmail.com</a>>> wrote:<br><br> > Is there an efficient way to find if a BibleBook is<br> contained in a Book (Bible or commentary) using JSword?<br> ><br> > I recall this subject being discussed but can't recall the<br> outcome.<br> ><br> > Thanks<br> > Martin</blockquote></blockquote></div></blockquote></div></div></div></body></html>