<div dir="ltr">Hi <span style="font-family:arial,sans-serif;font-size:13px">Stephan,</span><div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">That is the way it used to work but a few months ago DM created a script to automatically build the AV zip files because i</span><span style="font-family:arial,sans-serif;font-size:13px">f a zip file doesn't exist then JSword apps throw an error when a user tries to download the module.</span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">Cheers</span></div><div><span style="font-family:arial,sans-serif;font-size:13px">Martin</span></div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On 19 October 2013 12:43, Stephan <span dir="ltr"><<a href="mailto:info@tetzels.de" target="_blank">info@tetzels.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
The zip files are only created if you use the ModDisp.jsp script/applet. (<a href="http://www.crosswire.org/sword/modules/ModDisp.jsp?modType=Bibles&av=true" target="_blank">http://www.crosswire.org/<u></u>sword/modules/ModDisp.jsp?<u></u>modType=Bibles&av=true</a>)<br>
<br>
Best Regards,<br>
Stephan<br>
<br>
Am 19.10.2013 15:58, schrieb Martin Denham:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
Hi,<br>
<br>
Could somebody check the script that automatically creates the AV .zip<br>
files is still running?<br>
<br>
I had problems downloading RusSynodalLIO and OSHB via JSword and found<br>
the zips were missing. I have just forced the creation of RusSynodalLIO<br>
by selecting the jar from ModDisp.jsp and that now exists. I have not<br>
forced creation of OSHB yet in case somebody wanted to verify the<br>
OSHB.zip file is not there first.<br>
<br>
Here is where I am looking:<br>
<a href="http://www.crosswire.org/ftpmirror/pub/sword/avpackages/rawzip/" target="_blank">http://www.crosswire.org/<u></u>ftpmirror/pub/sword/<u></u>avpackages/rawzip/</a><br>
The RusSynodalLIO zip now exists because I just triggered creation:<br>
RusSynodalLIO.zip 19-Oct-2013 01:513.0M<br>
<br>
but there is no OSHB.zip<br>
<br>
Thanks<br>
Martin<br>
<br>
<br>
<br>
<br>
On 30 July 2013 22:43, DM Smith <<a href="mailto:dmsmith@crosswire.org" target="_blank">dmsmith@crosswire.org</a><br></div><div><div class="h5">
<mailto:<a href="mailto:dmsmith@crosswire.org" target="_blank">dmsmith@crosswire.org</a>><u></u>> wrote:<br>
<br>
Thanks for everyone's input.<br>
<br>
Attached is a shell script which is modelled after<br>
<a href="http://crosswire.org/svn/crosswire-java/trunk/src/org/crosswire/sword/web/PackageMod.java" target="_blank">http://crosswire.org/svn/<u></u>crosswire-java/trunk/src/org/<u></u>crosswire/sword/web/<u></u>PackageMod.java</a>.<br>
PackageMod.java does the following:<br>
Zipping is only done if at least one of the module's files or conf<br>
has a more recent modification time than the zip.<br>
The name of the zip is taken from the [NAME] in the conf.<br>
The zip overwrites any existing zip.<br>
<br>
My script differs slightly:<br>
It zips to a temporary file in the same directory and then copies it<br>
over top of the existing zip.<br>
It manages the mods.d.tar.gz file when a zip is created, again by<br>
creating a temporary and moving that over top of the existing.<br>
It assumes that there are no spaces in any path and that the<br>
repository is on UNIX.<br>
<br>
I've tried this on all the repositories I could find.<br>
<br>
I did find that there were a few conf files that did not have module<br>
files. Should these confs be renamed, deleted, or otherwise moved<br>
out of the way.<br>
<br>
I did not update/manage InstallSize, which could be easily added.<br>
<br>
Please review and comment.<br>
<br>
BTW, it is very verbose.<br>
<br>
In Him,<br>
DM<br>
<br>
<br>
<br>
On Jul 21, 2013, at 5:00 AM, "Troy A. Griffitts"<br></div></div>
<<a href="mailto:scribe@crosswire.org" target="_blank">scribe@crosswire.org</a> <mailto:<a href="mailto:scribe@crosswire.org" target="_blank">scribe@crosswire.org</a>>> wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
A few quick comments.<br>
<br>
If you're using http to grab the zips, we already have an http URL<br>
which will be sure to give you the latest zip-- the packager.<br>
<br>
If I implement the cache mechanism in the engine, I will use the<br>
same logic as what is in the packager to determine if any found<br>
zip is current.<br>
<br>
The code for the packager is in the crosswire-java svn repo. You<br>
should be able to find the servlet with a grep. Old sucky code I'm<br>
not proud of but works.<br>
<br>
Chris Little <<a href="mailto:chrislit@crosswire.org" target="_blank">chrislit@crosswire.org</a><br></div><div class="im">
<mailto:<a href="mailto:chrislit@crosswire.org" target="_blank">chrislit@crosswire.org</a><u></u>>> wrote:<br>
<br>
On 07/20/2013 03:05 PM, DM Smith wrote:<br>
<br>
On Jul 20, 2013, at 5:42 PM, Chris Little<br></div>
<<a href="mailto:chrislit@crosswire.org" target="_blank">chrislit@crosswire.org</a> <mailto:<a href="mailto:chrislit@crosswire.org" target="_blank">chrislit@crosswire.org</a><u></u>>><div><div class="h5">
<br>
wrote:<br>
<br>
On 07/20/2013 07:14 AM, Martin Denham wrote:<br>
<br>
They should be there again now. And Bible depends<br>
on the av repository.<br>
<br>
See this thread for more info:<br>
<a href="http://svn.crosswire.org/pipermail/jsword-devel/2013-April/004639.html" target="_blank">http://svn.crosswire.org/<u></u>pipermail/jsword-devel/2013-<u></u>April/004639.html</a><br>
<br>
It is a real shame the av zips are not created<br>
automatically.<br>
<br>
<br>
<br>
Or...<br>
It's a real shame that JSword doesn't use the<br>
repositories correctly, according to their intended usage.<br>
<br>
<br>
Yes it is a shame. I'm almost done w the code to use the<br>
expanded repository via ftp. This will be with the release<br>
after next.<br>
<br>
<br>
Awesome.<br>
<br>
Or...<br>
It's a real shame you don't write a cron job that can<br>
update the ZIPs nightly, if necessary. (Maybe Karl can<br>
help you, if he has a script to update ZIPs in his<br>
repository.)<br>
<br>
<br>
Can anyone point me to the code that does the zipping?<br>
While coding it up is trivial, there's no point to<br>
re-inventing the wheel. Just port the code to a loop.<br>
<br>
The latter is probably more useful at this point and<br>
more urgent since I am going to write a cron job to<br>
delete the ZIPs on occasion.<br>
<br>
<br>
Please don't do this until we have had a chance to write<br>
the script.<br>
<br>
<br>
<br>
Yeah, it's not urgent. It can wait a while. And I only intend to have it<br>
run once a week or so.<br>
<br>
What would the purpose of doing the mass deletes?<br>
Currently JSword uses the file time to determine whether<br>
the module has changed. Since our frontends do not<br>
advertise updated modules, this is no big deal. We've got<br>
the mechanism written to use the conf version field, but<br>
it is not in the frontends yet.<br>
<br>
<br>
<br>
There are a couple of reasons to clear out the cache on occasion. The<br>
web download applet will generate ZIPs for updates and new modules, but<br>
don't remove pulled modules (and sometimes I forget to do it manually).<br>
<br>
We also get people who think they're really smart and start feeding the<br>
download applet things like NIV and NKJV. And the applet will happily<br>
package those for them (except that they are empty of content). So it's<br>
<br>
nice to clear out those sorts of files from the server.<br>
<br>
If the purpose is to ensure that old stuff is<br>
appropriately deleted, then a script comparing module conf<br>
to zips deleting those that don't match would be better.<br>
This is even simpler to write than the zipper program.<br>
This could be added to the zipper program.<br>
<br>
<br>
<br>
Sure, there are other ways of handling the issues.<br>
<br>
BTW, Troy's position has been that it is OK to go to the<br>
zip cache first and failing that get the module by parts.<br>
But that there should be no requirement of a frontend to<br>
have the zips. Many have noted that getting the zip is<br>
faster and more reliable than getting by parts.<br>
<br>
<br>
<br>
At present, I believe that is a bad position. Shortly after updates,<br>
ZIPs and the module parts can get out of sync so that, e.g., you think<br>
you're downloading version 2.0 of a module, but you're actually<br>
<br>
downloading 1.0 since that's what the ZIP is because no one has<br>
downloaded through the applet, causing the ZIP to update. And no amount<br>
to trying to update from the ZIP is going to update to 2.0 until someone<br>
<br>
else hits the download applet.<br>
<br>
A cron job running an update script would at least mean that both the<br>
mods.d.tar.gz and ZIPs get updated at approximately the same time.<br>
<br>
--Chris<br>
<br>
<br>
<br></div></div>
------------------------------<u></u>------------------------------<u></u>------------<br>
<br>
sword-devel mailing <a href="mailto:list%3Asword-devel@crosswire.org" target="_blank">list:sword-devel@crosswire.org</a> <mailto:<a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.<u></u>org</a>><div class="im">
<br>
<br>
<a href="http://www.crosswire.org/mailman/listinfo/sword-devel" target="_blank">http://www.crosswire.org/<u></u>mailman/listinfo/sword-devel</a><br>
Instructions to unsubscribe/change your settings at above page<br>
<br>
<br>
--<br>
Sent from my Android phone with K-9 Mail. Please excuse my brevity.<br>
______________________________<u></u>_________________<br>
sword-devel mailing list: <a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.org</a><br></div>
<mailto:<a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.<u></u>org</a>><div class="im"><br>
<a href="http://www.crosswire.org/mailman/listinfo/sword-devel" target="_blank">http://www.crosswire.org/<u></u>mailman/listinfo/sword-devel</a><br>
Instructions to unsubscribe/change your settings at above page<br>
</div></blockquote><div class="im">
<br>
<br>
______________________________<u></u>_________________<br>
sword-devel mailing list: <a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.org</a><br></div>
<mailto:<a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.<u></u>org</a>><div class="im"><br>
<a href="http://www.crosswire.org/mailman/listinfo/sword-devel" target="_blank">http://www.crosswire.org/<u></u>mailman/listinfo/sword-devel</a><br>
Instructions to unsubscribe/change your settings at above page<br>
<br>
<br>
<br>
<br>
______________________________<u></u>_________________<br>
sword-devel mailing list: <a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.org</a><br>
<a href="http://www.crosswire.org/mailman/listinfo/sword-devel" target="_blank">http://www.crosswire.org/<u></u>mailman/listinfo/sword-devel</a><br>
Instructions to unsubscribe/change your settings at above page<br>
<br>
</div></blockquote><div class="HOEnZb"><div class="h5">
<br>
______________________________<u></u>_________________<br>
sword-devel mailing list: <a href="mailto:sword-devel@crosswire.org" target="_blank">sword-devel@crosswire.org</a><br>
<a href="http://www.crosswire.org/mailman/listinfo/sword-devel" target="_blank">http://www.crosswire.org/<u></u>mailman/listinfo/sword-devel</a><br>
Instructions to unsubscribe/change your settings at above page<br>
</div></div></blockquote></div><br></div>