<html aria-label="message body"><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">I watched “top” sorted by RSS and Jira was at the top. The RSS slowly went up to 1.5G and then 1.6 and finally to 1.7. But processes went from 500 or so to over 1200, when I fell asleep watching it die a third time. Lisa alerted me that I had fallen asleep!<div><br></div><div>I noticed that 3 of the top processes, all java, were killed. 2 restarted (monit?). The number of processes dropped to around 500 and have been creeping upward and it’s nearly 900 now.</div><div><br></div><div>I continued to watch and swordweb died and restarted again.</div><div><br></div><div>Hope this helps.</div><div><br></div><div>DM<br><div><br><div><blockquote type="cite"><div>On Sep 10, 2025, at 4:47 PM, DM Smith <dmsmith@crosswire.org> wrote:</div><br class="Apple-interchange-newline"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">And it died again after a few minutes. I restarted it. Not hopeful.<div><br></div><div>— DM<br id="lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On Sep 10, 2025, at 4:17 PM, DM Smith <dmsmith@crosswire.org> wrote:</div><br class="Apple-interchange-newline"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">I don’t know how to triage or fix the underlying problem. I’ve restarted it.<div><br></div><div>Looking at /var/log/messages, it is a machine OOM. Same as what Troy saw before. I’m guessing that the “OOM Reaper” is picking the biggest memory hogs and killing them. Those are all java processes.</div><div><div><br></div><div>There are many, many (~200) sword observer processes each taking a paltry 90,000 KB. Perhaps these are the culprits? Is there a bound on the pool of sword observers?</div><div><br></div><div>I also noted that:</div><div>When the large java process is killed (which belongs to Jira) that many mariadb connections by jira are terminated.</div><div>Jira needs to be updated from its current outdated version. Perhaps the newer version has a better memory footprint?</div><div><br></div><div>— DM<br id="lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On Sep 10, 2025, at 8:11 AM, Karl Kleinpaste <karl@kleinpaste.org> wrote:</div><br class="Apple-interchange-newline"><div>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<div>
<div class="moz-cite-prefix">On 9/9/25 3:57 PM, DM Smith wrote:<br>
</div>
<blockquote type="cite" cite="mid:566A2789-8A0C-4AB6-882A-480D4CB00796@crosswire.org">I
restarted it.</blockquote>
<br>
<font face="FreeSerif">And it's dead again.<br>
<br>
Something is evidently more seriously wrong than a mere need to
restart.<br>
</font>
</div>
_______________________________________________<br>server-admins mailing list<br>server-admins@crosswire.org<br>https://crosswire.org/mailman/listinfo/server-admins<br></div></blockquote></div><br></div></div></div>_______________________________________________<br>server-admins mailing list<br>server-admins@crosswire.org<br>https://crosswire.org/mailman/listinfo/server-admins<br></div></blockquote></div><br></div></div>_______________________________________________<br>server-admins mailing list<br>server-admins@crosswire.org<br>https://crosswire.org/mailman/listinfo/server-admins<br></div></blockquote></div><br></div></div></body></html>