<div dir="ltr"><div><br></div><div><br></div><div>Yes, I can provide you all information you need. Xymon was upgraded on 15 July and this is memory graph:</div><div><br></div><img src="cid:ii_1475cedc22f92342" alt="Inline image 1" width="562" height="196"><br>
<div><br></div><div class="gmail_extra">Xymon is instaled in Debian 6.0.9.</div><div class="gmail_extra"><br></div><div class="gmail_extra">This are our ulimit configuration. We didn't change it so it should be defaults values:</div>
<div class="gmail_extra">-----------------------------------------------------------------------</div><div class="gmail_extra">root: #ulimit -a</div><div class="gmail_extra">core file size (blocks, -c) 0</div><div class="gmail_extra">
data seg size (kbytes, -d) unlimited</div><div class="gmail_extra">scheduling priority (-e) 0</div><div class="gmail_extra">file size (blocks, -f) unlimited</div><div class="gmail_extra">
pending signals (-i) 63975</div><div class="gmail_extra">max locked memory (kbytes, -l) 64</div><div class="gmail_extra">max memory size (kbytes, -m) unlimited</div><div class="gmail_extra">open files (-n) 1024</div>
<div class="gmail_extra">pipe size (512 bytes, -p) 8</div><div class="gmail_extra">POSIX message queues (bytes, -q) 819200</div><div class="gmail_extra">real-time priority (-r) 0</div><div class="gmail_extra">
stack size (kbytes, -s) 8192</div><div class="gmail_extra">cpu time (seconds, -t) unlimited</div><div class="gmail_extra">max user processes (-u) 63975</div><div class="gmail_extra">
virtual memory (kbytes, -v) unlimited</div><div class="gmail_extra">file locks (-x) unlimited</div><div><br></div><div class="gmail_extra">xymon: $ ulimit -a</div><div class="gmail_extra">time(seconds) unlimited</div>
<div class="gmail_extra">file(blocks) unlimited</div><div class="gmail_extra">data(kbytes) unlimited</div><div class="gmail_extra">stack(kbytes) 8192</div><div class="gmail_extra">coredump(blocks) 0</div>
<div class="gmail_extra">memory(kbytes) unlimited</div><div class="gmail_extra">locked memory(kbytes) 64</div><div class="gmail_extra">process 63975</div><div class="gmail_extra">nofiles 1024</div>
<div class="gmail_extra">vmemory(kbytes) unlimited</div><div class="gmail_extra">locks unlimited</div><div class="gmail_extra"> ------------------------------------------------------------<br><br>We monitor 1200 hosts and don't add or remove many hosts. May be 20 host a week:</div>
<div class="gmail_extra"><br></div><div class="gmail_extra"><br></div><div class="gmail_extra"><img src="cid:ii_1475d1ca59c95619" alt="Inline image 2" width="562" height="173"><br></div><div class="gmail_extra"><br></div>
<div class="gmail_extra">xymond test is:</div><div class="gmail_extra">----------------------------------------------------------------</div><div class="gmail_extra"><div class="gmail_extra">Statistics for Xymon daemon</div>
<div class="gmail_extra">Version: 4.3.17</div><div class="gmail_extra">Up since 21-Jul-2014 11:37:37 (0 days, 22:00:00)</div><div class="gmail_extra"><br></div><div class="gmail_extra">Incoming messages : 4335475</div>
<div class="gmail_extra">- status : 2251363</div><div class="gmail_extra">- combo : 24050</div><div class="gmail_extra">- extcombo : 104869</div><div class="gmail_extra">
- page : 160</div><div class="gmail_extra">- summary : 0</div><div class="gmail_extra">- data : 1354532</div><div class="gmail_extra">- client : 92341</div>
<div class="gmail_extra">- notes : 0</div><div class="gmail_extra">- enable : 0</div><div class="gmail_extra">- disable : 0</div><div class="gmail_extra">
- ack : 2</div><div class="gmail_extra">- config : 5968</div><div class="gmail_extra">- query : 4471</div><div class="gmail_extra">- xymondboard : 146651</div>
<div class="gmail_extra">- xymondlog : 341645</div><div class="gmail_extra">- drop : 3</div><div class="gmail_extra">- rename : 0</div><div class="gmail_extra">
- dummy : 328</div><div class="gmail_extra">- ping : 0</div><div class="gmail_extra">- notify : 0</div><div class="gmail_extra">- schedule : 298</div>
<div class="gmail_extra">- download : 0</div><div class="gmail_extra">- Bogus/Timeouts : 8794</div><div class="gmail_extra">Incoming messages/sec : 52 (average last 300 seconds)</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">status channel messages: 2244782 (1 readers)</div><div class="gmail_extra">stachg channel messages: 10913 (1 readers)</div><div class="gmail_extra">page channel messages: 49720 (1 readers)</div>
<div class="gmail_extra">data channel messages: 1349077 (1 readers)</div><div class="gmail_extra">notes channel messages: 0 (0 readers)</div><div class="gmail_extra">enadis channel messages: 0 (0 readers)</div>
<div class="gmail_extra">client channel messages: 90465 (1 readers)</div><div class="gmail_extra">clichg channel messages: 360 (1 readers)</div><div class="gmail_extra">user channel messages: 0 (0 readers)</div>
<div class="gmail_extra">backfeed messages : 0</div><div class="gmail_extra"><br></div><div class="gmail_extra">Ghost reports:</div><div class="gmail_extra"> 10.6.71.66 reported host </div><div class="gmail_extra">
10.6.42.103 reported host 10.6.42.10</div><div class="gmail_extra"> 10.6.42.103 reported host 10.6.42.11</div><div class="gmail_extra"> 10.6.42.103 reported host 10.6.42.12</div><div class="gmail_extra"> 10.6.42.103 reported host 10.6.42.13</div>
<div class="gmail_extra"> 10.6.42.103 reported host 10.6.42.14</div><div class="gmail_extra"> 10.6.42.103 reported host 10.6.42.15</div><div class="gmail_extra"> 10.6.42.103 reported host 10.6.42.4</div><div class="gmail_extra">
10.6.42.103 reported host 10.6.42.5</div><div class="gmail_extra"> 10.1.0.194 reported host ePagess_app_3</div><div class="gmail_extra"> 10.1.0.86 reported host IIS6_6_1</div><div class="gmail_extra"> 10.1.0.87 reported host IIS6_6_2</div>
<div class="gmail_extra"> 10.1.0.194 reported host main0404</div><div class="gmail_extra"><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">Multi-source statuses</div><div class="gmail_extra"> admin01:conn reported by 10.6.42.103 and 10.0.0.29</div>
</div><div class="gmail_extra">----------------------------------------------------------------------------------------------------<br><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">And xymond section in task.cfg:</div>
<div class="gmail_extra"><br><div class="gmail_extra">[xymond]</div><div class="gmail_extra"> ENVFILE /usr/lib/xymon/server/etc/xymonserver.cfg</div><div class="gmail_extra"> CMD xymond --pidfile=$XYMONSERVERLOGS/xymond.pid \</div>
<div class="gmail_extra"> --restart=$XYMONTMP/xymond.chk --checkpoint-file=$XYMONTMP/xymond.chk --checkpoint-interval=600 \</div><div class="gmail_extra"> --log=$XYMONSERVERLOGS/xymond.log \</div><div class="gmail_extra">
--admin-senders=127.0.0.1,$XYMONSERVERIP \</div><div class="gmail_extra"> --store-clientlogs=!msgs \</div><div class="gmail_extra"> --maint-senders=127.0.0.1,$XYMONSERVERIP \</div><div class="gmail_extra">
--www-senders=127.0.0.1,<a href="http://10.0.0.0/24,10.6.42.103">10.0.0.0/24,10.6.42.103</a> \</div><div class="gmail_extra"> --flap-count=10 \</div><div class="gmail_extra"> --flap-seconds=900</div>
<div><br></div><br>We also change some MAX variables in xymonserver.cfg:</div><div class="gmail_extra"><div class="gmail_extra">MAXLINE="32768"</div><div class="gmail_extra">MAXMSG_DATA="5242880"</div>
<div class="gmail_extra">MAXMSG_CLIENT="5242880"</div><div class="gmail_extra">MAXMSG_STATUS="5242880"</div><div><br></div><div>Thank you for you help.</div><div><br></div><br><div class="gmail_quote">
On Mon, Jul 21, 2014 at 7:12 PM, J.C. Cleaver <span dir="ltr"><<a href="mailto:cleaver@terabithia.org" target="_blank">cleaver@terabithia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div class=""><div class="h5"><br>
<br>
On Mon, July 21, 2014 3:24 am, Raul GN wrote:<br>
> After upgrading from xymon version 4.3.12 to 4.3.17 xymond daemon memory<br>
> grow without any limit. After a 2 or 3 days this messages appear in logs:<br>
><br>
> 2014-07-17 16:27:46 Setup complete<br>
> 2014-07-18 04:16:49 Flapping detected for web.int:http - 10 changes in 868<br>
> seconds<br>
> 2014-07-18 04:16:49 Flapping detected for web.int:tomcat - 10 changes in<br>
> 868 seconds<br>
> 2014-07-18 04:18:23 Flapping detected for web.int:http - 10 changes in 892<br>
> seconds<br>
> 2014-07-18 04:18:23 Flapping detected for web.int:tomcat - 10 changes in<br>
> 892 seconds<br>
> 2014-07-18 18:25:44 Flapping detected for web.int:http - 10 changes in 808<br>
> seconds<br>
> 2014-07-18 18:25:44 Flapping detected for web.int:tomcat - 10 changes in<br>
> 808 seconds<br>
> 2014-07-18 23:40:53 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-18 23:50:54 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 00:00:55 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 00:10:56 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 00:20:57 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 00:30:58 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 00:40:59 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 00:51:00 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 01:01:01 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 01:11:02 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 01:21:03 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 01:31:04 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 01:41:05 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 01:51:06 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 02:01:07 Could not fork checkpoint child:Cannot allocate memory<br>
> 2014-07-19 02:11:08 Could not fork checkpoint child:Cannot allocate memory<br>
><br>
> żAnybody knows how to avoid this problem? If I don't reboot xymon it<br>
> crash.<br>
</div></div>> _______________________________________________<br>
<br>
<br>
Hmm. If it's growing truly without limit there's something unusual going<br>
on; I'd take the memory allocation error later on at face value.<br>
<br>
Can you provide any additional details? Do you have an unusual workload or<br>
ulimits on the xymon user? Or a large number of host inserts/removals?<br>
What OS are you running?<br>
<br>
<br>
Regards,<br>
<br>
-jc<br>
<br>
</blockquote></div><br></div></div>