[Xymon] Big RRD files causing problems

[Mills,David (HHSC Contractor)]

Thx, Jeremy!


~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~
David Mills
Systems Administrator
Northrop Grumman
(512) 595-1238 (mobile)

From: Jeremy Laidman [mailto:jlaidman at rebel-it.com.au]
Sent: Wednesday, November 8, 2017 9:20 PM
To: Mills,David (HHSC Contractor) <David.Mills at hhsc.state.tx.us>
Cc: xymon at xymon.com
Subject: Re: [Xymon] Big RRD files causing problems

David

RRD files are fixed in size - they never grow. The only grooming that would need to be repeated periodically, would be RRD filenames that are dynamic in nature. These are for things such as mounted filesystems, which can change over time (but usually don't), and for tracked logfile linecounts where the logfilenames are populated by backticks. These types of dynamic RRD files typically have commas in their names, such as "lines.,var,log,messages#error.rrd" or "disk,home.rrd".

I can imagine a situation where an automounter magically mounts a USB stick to some random mountpoint dirname, and Xymon dutifully starts collecting data for it, but when the USB stick removed, the RRD file stays. Then the next USB stick that's inserted gets a new random mountpoint dirname, and hence a new RRD file. And so on.

I would be looking for new RRD files that appear out of nowhere, or ones that have not been updated for a while, and try to find out where they come from.

Cheers
Jeremy


On 12 September 2017 at 15:53, Mills,David (HHSC Contractor) <David.Mills at hhsc.state.tx.us<mailto:David.Mills at hhsc.state.tx.us>> wrote:
Hi!

Since upgrading to a new Xymon (  4.3.28-1.el6.terabithia<http://xymon.sourceforge.net/> / Linux from 4.3.3 on Solaris ) , my RRD file storage consumption is *much* greater than on the old server. It’s gotten so I have to manually groom the RRD files every 48 hours or they overflow the file system. Here are some stats:

NOTE: Same set of hosts with same tests on both the old server (4.3.3 / Solaris) and the Terabithia distro for RHEL 6:

Picking out the current biggest offender (the list varies but tracks pretty much along the lines of the largest hosts with the most data to send):

                                     NEW Server        OLD Server
Total space consumed for …/rrd       90GB               14GB
# of files beneath …/rrd/pwow706/    1,916               25,815
Avg file size (eyeballing it)        423K               38K

Any ideas?

Where can I read up on what RRD files Xymon puts into the RRD directory?
Thx!

;-)

David Mills
~~~~~~~~~~~~~~~~~~~~~~~~
System Administrator
Northrop Grumman
Texas Health and Human Services Commission


_______________________________________________
Xymon mailing list
Xymon at xymon.com<mailto:Xymon at xymon.com>
http://lists.xymon.com/mailman/listinfo/xymon

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.xymon.com/pipermail/xymon/attachments/20171109/a805e48f/attachment.html>