<html><head></head><body> <div dir="auto">How does Dom’s module release script determine the right BlockType for a module?</div><div><br></div> <div><br></div><div><br></div>On Mon, May 5, 2025 at 16:50, DM Smith <<a class="" href="mailto:On Mon, May 5, 2025 at 16:50, DM Smith <<a href=">dmsmith@crosswire.org</a>> wrote:<blockquote type="cite" class="protonmail_quote"> The BlockType, if I remember correctly, is the unit of compression/retrieval from the module and the size of the block is constrained (to what size I don’t remember) to prevent “integer” overflow in the index.
<div>
<br>
</div>
<div>
For a given input, the larger the block size of what is being compressed, the smaller the total size of the module. Since most SWORD applications show a chapter at a time, it is a better unit for retrieval. If you were to have a commentary using the module format, you might need VERSE as your unit.
<br id="lineBreakAtBeginningOfMessage">
<div>
<br>
<blockquote type="cite">
<div>
On May 2, 2025, at 10:55 PM, David Haslam <dfhdfh@protonmail.com> wrote:
</div>
<br class="Apple-interchange-newline">
<div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<span style="font-size: 12pt; line-height: normal;"><b style="line-height: normal;">Update:</b></span>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
Rebuilding the module with
<b>BlockType=CHAPTER</b> solved the buffer issue. Hurrah!
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
The
<b>cmd</b> file now reads:
</div>
<blockquote style="border-left: 3px solid rgb(200, 200, 200); border-top-color: rgb(200, 200, 200); border-right-color: rgb(200, 200, 200); border-bottom-color: rgb(200, 200, 200); padding-left: 10px; color: rgb(102, 102, 102);">
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<span>cd ..</span>
<div>
<span>xiphos\imp2vs Import\IMP\KhmerNTw.raw.imp.txt -z <b>-b 3</b> -o .\modules\texts\ztext\khmerntw 1>log\imp2vs.log 2>log\error.log</span>
</div>
<div>
<br>
</div>
<span>pause</span>
<br>
</div>
</blockquote>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;" class="protonmail_signature_block">
<div class="protonmail_signature_block-user">
Useful lesson learned about module building!
<br>cf. This is the first time ever that I have needed to use a
<b>BlockType</b>
<span style="display: inline !important; background-color: rgb(255, 255, 255);">smaller<span> than <b>BOOK</b>.</span></span>
<br>
<br>
<u>Aside</u>: Now that I am using the
<u>milestone marker</u> form of the ZWSP,
<b>diatheke</b> starts each lexical Khmer word on a new line, though
<b>Xiphos</b> displays the verse text correctly!
<br>
<br>
<i>Any ideas towards an explanation?</i>
</div>
<div class="protonmail_signature_block-user">
<br>
</div>
<div class="protonmail_signature_block-user">
Best regards,
<br>
<br>David
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div class="protonmail_signature_block-proton">
Sent with
<a href="https://pr.tn/ref/SWXT9A5YZ67G" target="_blank">Proton Mail</a> secure email.
</div>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div class="protonmail_quote">
On Friday, May 2nd, 2025 at 4:48 PM, David Haslam <dfhdfh@protonmail.com> wrote:
<br>
<blockquote type="cite" class="protonmail_quote">
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<b>ztext</b>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
The module was built using the following
<b>cmd</b> file stored in a directory called
<b>Make</b> under my SWORD path.
<br>
<br>
<blockquote style="border-left: 3px solid rgb(200, 200, 200); border-top-color: rgb(200, 200, 200); border-right-color: rgb(200, 200, 200); border-bottom-color: rgb(200, 200, 200); padding-left: 10px; color: rgb(102, 102, 102);">
<div>
<span>cd ..</span>
<div>
<span>xiphos\imp2vs Import\IMP\KhmerNTw.raw.imp.txt -z -o .\modules\texts\ztext\khmerntw 1>log\imp2vs.log 2>log\error.log</span>
</div>
<div>
<br>
</div>
<span>pause</span>
<br>
</div>
</blockquote>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div class="protonmail_signature_block" style="font-family: Arial, sans-serif; font-size: 14px;">
<div class="protonmail_signature_block-user">
Best regards,
<br>
<br>David
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div class="protonmail_signature_block-proton">
Sent with
<a rel="noreferrer nofollow noopener" target="_blank" href="https://pr.tn/ref/SWXT9A5YZ67G">Proton Mail</a> secure email.
</div>
</div>
<div style="font-family: Arial, sans-serif; font-size: 14px;">
<br>
</div>
<div class="protonmail_quote">
On Friday, May 2nd, 2025 at 4:35 PM, Greg Hellings <greg.hellings@gmail.com> wrote:
<br>
<blockquote class="protonmail_quote" type="cite">
<div dir="auto">
Which driver have you used? RawText? zText? That might influence a buffer size.
</div>
<br>
<div class="gmail_quote gmail_quote_container">
<div class="gmail_attr" dir="ltr">
On Fri, May 2, 2025, 9:07 AM David Haslam <
<a href="mailto:dfhdfh@protonmail.com" rel="noreferrer nofollow noopener">dfhdfh@protonmail.com</a>> wrote:
<br>
</div>
<blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" class="gmail_quote">
<div style="font-family:Arial,sans-serif;font-size:14px">
While experimenting with the
<b>KhmerNT</b> module eXperimental improvement, I encountered a new issue after creating modules using
<b>imp2vs</b>
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<br>
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
Earlier today, I had the "bright idea" of replacing all the ZWSP between Khmer words with the following OSIS element. NB. The marker attribute contains a ZWSP character
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<br>
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<span><milestone marker="" type="x-lexical-word-divider" subtype="x-ZWSP"/></span>
<br>
<br>Nothing wrong with that, you might assume, like I did.
<br>It's perfectly valid OSIS according to our schema and wiki.
<br>It's also much more explicit than simply leaving the ZWSP characters invisible to the naked eye.
<br>
<br>Only a few smaller books in the NT ever got compiled!
<br>Or if they did compile OK, afterwards SWORD cannot read parts of them.
<br>
<br>So, I thinks to myself, "let's make it a bit smaller", and I then tried again with this abbreviated attribute value.
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<br>
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<span style="display:inline!important;background-color:rgb(255,255,255)"><milestone marker="" type="x-LWD" subtype="x-ZWSP"/><br></span>
<br>A few more NT books were compiled this time, but the largest one visible was
<b>Hebrews</b>.
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
The apparently missing books just show as empty verses in
<b>Xiphos</b> and with
<b>emptyvss</b>.
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<br>
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<span style="display:inline!important;background-color:rgb(255,255,255)">I have attached the log file generated during the second attempt at module build.<br></span>NB. The
<b>error.log</b> was empty, which now rather makes me think it's a SWORD output issue.
<br>
<br>Using
<b>diatheke</b> and
<b>mod2imp</b> after the module was built, one or either of these gave this repeated message:
<br>
<br>
<span><b>ERROR: not enough room in the out buffer during decompression.</b><br></span>
<br>Evidently "
<span>Too many milestones can cook your buffer?"<br></span>
<br>I'd be happy to supply the IMP file and/or the module for further investigation.
<br>I think this is a serious issue. I'm surprised that it's never been encountered
<span style="display:inline!important;background-color:rgb(255,255,255)">hitherto</span>.
<br>
<br>
<div style="font-family:Arial,sans-serif;font-size:14px">
<div>
Best regards,
<br>
<br>David
</div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<br>
</div>
<div>
Sent with
<a rel="noreferrer nofollow noopener" target="_blank" href="https://pr.tn/ref/SWXT9A5YZ67G">Proton Mail</a> secure email.
</div>
</div>
</div>_______________________________________________
<br> sword-devel mailing list:
<a rel="noreferrer nofollow noopener" target="_blank" href="mailto:sword-devel@crosswire.org">sword-devel@crosswire.org</a>
<br>
<a target="_blank" rel="noreferrer nofollow noopener" href="http://crosswire.org/mailman/listinfo/sword-devel">http://crosswire.org/mailman/listinfo/sword-devel</a>
<br> Instructions to unsubscribe/change your settings at above page
<br>
</blockquote>
</div>
</blockquote>
<br>
</div>
</blockquote>
<br>
</div>_______________________________________________
<br>sword-devel mailing list: sword-devel@crosswire.org
<br>http://crosswire.org/mailman/listinfo/sword-devel
<br>Instructions to unsubscribe/change your settings at above page
<br>
</div>
</blockquote>
</div>
<br>
</div></blockquote></body></html>