<div dir="ltr">So the memory usage on the machine is fairly high. This system is a VM, and was built with only 2GB of memory, of which about 1.8GB is in use. I have a maintenance window coming up this week where I am going to increase the available memory to the server, but I will also try to inject the 2 MALLOC debugging that you suggested into things as well to watch for additional issues as time goes on. Hopefully that can help to identify where the problem lies and I can be a testbed to help determine a resolution.<div><br></div><div>Greg.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Oct 24, 2016 at 11:57 PM, Japheth Cleaver <span dir="ltr"><<a href="mailto:cleaver@terabithia.org" target="_blank">cleaver@terabithia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On 10/24/2016 10:59 AM, Greg Krpan wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I haven't noticed any errors through xymond_client or from debug mode.<br>
<br>
After running the xymoncmd line above I get the following:<br>
<br>
./xymoncmd xymon 127.0.0.1 "xymondlog wstc-lr0dhcp1.svcs"<br>
wstc-lr0dhcp1|svcs|red||147733<wbr>1698|1477331698|1477333498|0|<wbr>0|15.1.160.11|460159|||Y|<br>
red Mon Oct 24 11:55:55 2016 - Services NOT ok<br>
&red BBWin: No matching service - want started/automatic<br>
&green DHCPServer is started/automatic - want started/automatic<br>
&green McAfeeFramework is started/automatic - want started/automatic<br>
&green McShield is started/automatic - want started/automatic<br>
&green McTaskManager is started/automatic - want started/automatic<br>
&green VMTools is started/automatic - want started/automatic<br>
<br>
Name StartupType Status DisplayName<br>
AeLookupSvc manual stopped Application Experience<br>
ALG manual stopped Application Layer Gateway Service<br>
AppIDSvc manual stopped Application Identity<br>
Appinfo manual<br>
sta]ted Application Information<br>
AppMgmt manual stopped Application Management<br>
AppReadiness manual stopped App Readiness<br>
AppXSvc manual stopped AppX Deployment Service (AppXSVC)<br>
AudioEndpointBuilder manual stopped Windows Audio Endpoint Builder<br>
Audiosrv ]<br>
manual st]<br>
ped Windows Audio<br>
]BWin automatic started Big Brother Xymon Client<br>
BFE automatic started Base Filtering Engine<br>
</blockquote></div></div>
*snip*<br>
<br>
Thanks; that confirms that the issue involved xymond_client or xymond, and isn't related to the web display.<br>
<br>
Looking through the changes from 4.3.25 to 4.3.27, it's hard to see what might be causing this issue.<br>
<br>
Is there any chance you're under a significant memory pressure on this machine? Would you be able to add some glibc debugging at all?<br>
If so, would you be able to add an:<br>
(export) MALLOC_CHECK_=3<br>
(export) MALLOC_PERTURB_=1<br>
... into the environment? This might help trigger a memory issue that could otherwise go unnoticed.<br>
<br>
Alternatively, the next step might be to downgrade to 4.3.25 and see if that fixes the problem (if so, that really indicated there's a specific hidden issue here). Also, it might be interesting to see if the el7 Terabithia RPMs show the same problem for you. There was a significant increase in lookup/buffer debugging in xymond_client in there that's also in the 4.x-master branch but isn't in 4.3.x when compiled from source.<br>
<br>
Regards,<br>
-jc<br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>--------------------------------------------------------------------------- <br>In honor of those who lost their lives exploring the final frontier: <br>Apollo 1; January 27, 1967 Virgil "Gus" Ivan Grissom, Edward Higgins White II, Roger Bruce Chaffee <br></div><div style="text-align:left">Space Shuttle Challenger, Mission STS-51-L; January 28, 1986 Francis R. Scobee, Michael J. Smith, Judith A. Resnik, Ellison S. Onizuka, Ronald E. McNair, Gregory B. Jarvis, Sharon Christa McAuliffe <br></div><div>Space Shuttle Columbia, Mission STS-107; February 1, 2003 Rick D. Husband, William C. McCool, Michael P. Anderson, Kalpana Chawla, David M. Brown, Laurel Blair Salton Clark, Ilan Ramon<br></div></div></div>
</div>