Did you check to see if a xymonnet process is/was still running? If a process gets hung for some reason xymonlaunch won't start a new process. I had this happen to me once, but only once. There is also a --debug flag for xymonnet, but it produces a _lot_ of output, but it might give you some idea what is going on. <div>
<br></div><div>Thanks,<br>Larry Barber<br><br><div class="gmail_quote">On Tue, Nov 6, 2012 at 8:02 AM, Don Kuhlman <span dir="ltr"><<a href="mailto:Don.Kuhlman@schawk.com" target="_blank">Don.Kuhlman@schawk.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word">
<div>Thanks Larry. Looks like everything went purple again at 6:45 this morning. The logs still show 0 bytes.</div>
<div>Any other suggestions for trying to figure this out?</div>
<div><br>
</div>
<div>Regards,</div>
<div><br>
</div>
<div>Don</div>
<div><br>
</div>
<span>
<div style="border-right:medium none;padding-right:0in;padding-left:0in;padding-top:3pt;text-align:left;font-size:11pt;border-bottom:medium none;font-family:Calibri;border-top:#b5c4df 1pt solid;padding-bottom:0in;border-left:medium none">
<span style="font-weight:bold">From: </span>Larry Barber <<a href="mailto:lebarber@gmail.com" target="_blank">lebarber@gmail.com</a>><br>
<span style="font-weight:bold">Date: </span>Mon, 5 Nov 2012 17:19:53 -0600<br>
<span style="font-weight:bold">To: </span>Don Kuhlman <<a href="mailto:don.kuhlman@schawk.com" target="_blank">don.kuhlman@schawk.com</a>><div><div class="h5"><br>
<span style="font-weight:bold">Subject: </span>Re: [Xymon] FW: Troubleshooting Purple CONN and HTTP Tests in Xymon 4.3.10<br>
</div></div></div><div><div class="h5">
<div><br>
</div>
Xymonnet tends to be pretty quiet unless something goes wrong. You won't be able to tell for sure until you get one of your purple storms.
<div><br>
</div>
<div>Alerts are handled by a different module. Look in tasks.cfg to find it. </div>
<div><br>
</div>
<div>Thanks,</div>
<div>Larry Barber<br>
<br>
<div class="gmail_quote">On Mon, Nov 5, 2012 at 3:53 PM, Don Kuhlman <span dir="ltr">
<<a href="mailto:Don.Kuhlman@schawk.com" target="_blank">Don.Kuhlman@schawk.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word">
<div>Hi Larry/all. I've noticed that the xymonnet.log and xymonnet-again.log files are staying at 0 bytes. Does that seem to be indicating a problem?</div>
<div>(and Xymon hasn't gone purple all day, but I'm still not sending any email alerts to anyone).</div>
<div><br>
</div>
<div>
<div>-rw-rw-rw- 1 xymon xymon 0 Nov 5 15:05 /var/log/xymon/xymonnet-again.log</div>
<div>-rw-rw-rw- 1 xymon xymon 0 Nov 5 15:07 /var/log/xymon/xymonnet.log</div>
<div><br>
</div>
<div>Thanks</div>
<div><br>
</div>
<div>Don K</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div><br>
</div>
<span>
<div style="border-right:medium none;padding-right:0in;padding-left:0in;padding-top:3pt;text-align:left;font-size:11pt;border-bottom:medium none;font-family:Calibri;border-top:#b5c4df 1pt solid;padding-bottom:0in;border-left:medium none">
<div><span style="font-weight:bold">From: </span>Larry Barber <<a href="mailto:lebarber@gmail.com" target="_blank">lebarber@gmail.com</a>><br>
<span style="font-weight:bold">Date: </span>Mon, 5 Nov 2012 11:19:32 -0600<br>
<span style="font-weight:bold">To: </span>Don Kuhlman <<a href="mailto:don.kuhlman@schawk.com" target="_blank">don.kuhlman@schawk.com</a>><br>
</div>
<span style="font-weight:bold">Cc: </span>Xymon Email List <<a href="mailto:xymon@xymon.com" target="_blank">xymon@xymon.com</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [Xymon] FW: Troubleshooting Purple CONN and HTTP Tests in Xymon 4.3.10<br>
</div>
<div>
<div>
<div><br>
</div>
All the server side Xymon logs are in /var/log/xymon by default. Since you say that you are getting purple storms for conn and http tests, this suggests that the problem is likely with your xymonnet process. Check the xymonnet log, and when you see the purples
check to see if there is a xymonnet instance running. If this instance has been running for more than a few minutes, kill it. If the xymonnet process is hanging, you might want to set the MAXTIME parameter on the xymonnet process in tasks.cfg. Doesn't really
fix the problem, but it will at least stop things from going purple.
<div><br>
</div>
<div>Thanks,<br>
Larry Barber<br>
<br>
<div class="gmail_quote">On Mon, Nov 5, 2012 at 10:01 AM, Don Kuhlman <span dir="ltr">
<<a href="mailto:Don.Kuhlman@schawk.com" target="_blank">Don.Kuhlman@schawk.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word">
<div>Update to this. While googling further, I saw a thread titled "[hobbit] stale alerts". This mentioned that there could be an external script that I created which may cause issues for xymon when it runs. I do have a diskstat.sh script that may be causing
problems. For now, I'm setting it to DISABLED in the tasks.cfg file.</div>
<div><br>
</div>
<div>Is there a way to see log information in xymon to try and verify something like this?</div>
<div><br>
</div>
<div>Thanks</div>
<div><br>
</div>
<div>Don K</div>
<div><br>
</div>
<span>
<div style="border-right:medium none;padding-right:0in;padding-left:0in;padding-top:3pt;text-align:left;font-size:11pt;border-bottom:medium none;font-family:Calibri;border-top:#b5c4df 1pt solid;padding-bottom:0in;border-left:medium none">
<span style="font-weight:bold">From: </span>Don Kuhlman <<a href="mailto:don.kuhlman@schawk.com" target="_blank">don.kuhlman@schawk.com</a>><br>
<span style="font-weight:bold">Date: </span>Mon, 5 Nov 2012 08:34:29 -0600<br>
<span style="font-weight:bold">To: </span>Xymon Email List <<a href="mailto:xymon@xymon.com" target="_blank">xymon@xymon.com</a>><br>
<span style="font-weight:bold">Subject: </span>Troubleshooting Purple CONN and HTTP Tests in Xymon 4.3.10<br>
</div>
<div>
<div>
<div><br>
</div>
<div>
<div style="font-size:14px;font-family:Calibri,sans-serif;word-wrap:break-word">
<div>Hi folks. We've been running xymon for about 10 months now. It's been fine all this time.</div>
<div><br>
</div>
<div>However last week around Wednesday we started getting purple storms on the CONN and HTTP tests for all our hosts.</div>
<div>I stop Xymon and restart it, or reboot the server (Linux 5.x) and then it comes back ok.</div>
<div>This also happened Thursday, and then again Saturday around 2PM cst.</div>
<div><br>
</div>
<div>Anyone have a link or source for which logs to look in on the server or xymon to see what may be causing the CONN and HTTP tests to randomly start failing like this or where to start troubleshooting?</div>
<div><br>
</div>
<div>Can I use xymonlaunch —debug like this to see what is happening?</div>
<div>
<div> /usr/lib64/xymon/server/bin/xymonlaunch --debug --config=/usr/lib64/xymon/server/etc/tasks.cfg --env=/usr/lib64/etc/xymonserver.cfg</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>While searching the xymon forum and message boards, I saw some things that say it may be disk space or inodes, but it seems like we are ok there -</div>
<div>
<div>df -i</div>
<div>Filesystem Inodes IUsed IFree IUse% Mounted on</div>
<div>/dev/sda2 3899392 204731 3694661 6% /</div>
<div>tmpfs 490139 6 490133 1% /dev/shm</div>
<div>/dev/sda1 32768 51 32717 1% /boot</div>
</div>
<div><br>
</div>
<div>df</div>
<div>
<div>Filesystem 1K-blocks Used Available Use% Mounted on</div>
<div>/dev/sda2 61312028 5748784 52448700 10% /</div>
<div>tmpfs 1960556 188 1960368 1% /dev/shm</div>
<div>/dev/sda1 516040 87716 402112 18% /boot</div>
</div>
<div><br>
</div>
<div>DNS also seems fine.</div>
<div><br>
</div>
<div>Thanks</div>
<div><br>
</div>
<div>Don K</div>
</div>
</div>
</div>
</div>
</span></div>
<br>
_______________________________________________<br>
Xymon mailing list<br>
<a href="mailto:Xymon@xymon.com" target="_blank">Xymon@xymon.com</a><br>
<a href="http://lists.xymon.com/mailman/listinfo/xymon" target="_blank">http://lists.xymon.com/mailman/listinfo/xymon</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</span></div>
</blockquote>
</div>
<br>
</div>
</div></div></span>
</div>
<br>_______________________________________________<br>
Xymon mailing list<br>
<a href="mailto:Xymon@xymon.com">Xymon@xymon.com</a><br>
<a href="http://lists.xymon.com/mailman/listinfo/xymon" target="_blank">http://lists.xymon.com/mailman/listinfo/xymon</a><br>
<br></blockquote></div><br></div>