[Xymon] RRD files are too big

[Mills,David (HHSC Contractor)]

On a related note, I see lots (sometimes dozens, depending on the client) of RRD files with names “ifstat.#.#.#.#.rrd”, where the ‘#’ are numbers, like this sampling:

-rw-r-----    1 xymon xymon 423K Mar  6 20:07 ifstat.47.147.0.12.rrd
-rw-r-----    1 xymon xymon 423K Mar  6 20:12 ifstat.108.0.121.0.rrd
-rw-r-----    1 xymon xymon 423K Mar  7 02:53 ifstat.73.68.58.9.rrd
-rw-r-----    1 xymon xymon 423K Mar  7 09:23 ifstat.0.1.0.128.rrd
-rw-r-----    1 xymon xymon 423K Mar  7 09:23 ifstat.0.116.111.32.rrd
-rw-r-----    1 xymon xymon 423K Mar  7 09:23 ifstat.101.115.115.32.rrd

What are these numbers? I care because a host can have _lots_ of these files, and each currently takes up almost half a MB and we have thousands of hosts!

Thanks again for any help…

david


~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~
David Mills
Systems Administrator
Northrop Grumman
(512) 595-1238 (mobile)

From: Mills,David (HHSC Contractor)
Sent: Wednesday, March 28, 2018 9:54 AM
To: Jeremy Laidman <jeremy at laidman.org>
Cc: xymon at xymon.com
Subject: RE: [Xymon] RRD files are too big

Brilliant, Jeremy. Thx for the assist!


~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~
David Mills
Systems Administrator
Northrop Grumman
(512) 595-1238 (mobile)

From: Jeremy Laidman [mailto:jeremy at laidman.org]
Sent: Wednesday, March 28, 2018 8:54 AM
To: Mills,David (HHSC Contractor) <David.Mills at hhsc.state.tx.us<mailto:David.Mills at hhsc.state.tx.us>>
Cc: xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] RRD files are too big

Forgot to cc the list.

On Wed., 28 Mar. 2018, 10:50 am Jeremy Laidman, <jeremy at laidman.org<mailto:jeremy at laidman.org>> wrote:
I see the same thing.

Run "rrdtool info /path/to/file.rrd | grep cf" on both old and new RRD files. I'm guessing you will see many more consolidation functions in the newer RRD files. This may be due to an enhanced rrddefinitions.cfg file in the Terabithia package, apparently extended for the 4.3.13 release. The additional CFs are related to Holt-Winters prediction (HWPREDICT).

I suspect you could copy in the previous rrddefinitions.cfg file, delete an RRD file, and it'll get created without the extra CFs, and much smaller.

It may be possible to export, edit, import so as to not lose data.

J


On 28 March 2018 at 08:35, Mills,David (HHSC Contractor) <David.Mills at hhsc.state.tx.us<mailto:David.Mills at hhsc.state.tx.us>> wrote:
Hey, Folks…

I posted on this issue a few months ago (cf http://lists.xymon.com/archive/2017-November/045048.html),  but still need help.

I migrated / upgraded from Xymon 4.3.3 on a Solaris 10 host to a Linux host (RHEL 6) using the Terbithia binaries (4.3.28), and things have been doing well for the most part. Unfortunately the new RRD files are massively bigger than the original ones on the old server, causing a lot of space issues on the file system.

The old RRD files took up around 38KB each (avg.) but the new ones are fairly uniform at 400+KB each.

Can anyone please tell me how to get those big files down-sized back to something much closer to the old sizes? Or, perhaps, someone can point me at the parameters Xymon uses that determine the RRD file sizes?

FWIW, this is a representative listing of one host’s RRD files:

16:33:08 lwmp043:[xymon]/xymon-data/rrd> ls twiu003/
total 13M
drwxr-xr-x    2 xymon xymon 4.0K Feb 26 12:14 ./
drwxr-xr-x 6284 xymon xymon 204K Mar 22 07:39 ../
-rw-r--r--    1 xymon xymon 213K Mar 27 15:57 clock.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 15:52 disk,dev,odm.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:36 disk,dev,vx,dmp.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:31 disk,dev,vx,rdmp.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 16:12 disk,dpool.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 15:41 disk,etc,dfs,sharetab.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 15:57 disk,etc,svc,volatile.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:31 disk,export.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 16:17 disk,export,zones,cit032.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 15:01 disk,export,zones,clt031.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:41 disk,export,zones.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 15:16 disk,root.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:46 disk,tmp.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:56 disk,var.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:56 ifstat.aggr2.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 15:01 ifstat.aggr3.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:31 ifstat.e1000g3.rrd
-rw-r--r--    1 xymon xymon 423K Mar 27 14:31 ifstat.nxge0.rrd
-rw-r--r--    1 xymon xymon 213K Mar 27 15:01 la.rrd
-rw-r--r--    1 xymon xymon 213K Mar 27 15:11 memory.real.rrd
-rw-r--r--    1 xymon xymon 213K Mar 27 14:36 memory.swap.rrd
-rw-r--r--    1 xymon xymon 3.3M Mar 27 16:17 netstat.rrd
-rw-r--r--    1 xymon xymon 213K Mar 27 14:51 procs.rrd
-rw-r--r--    1 xymon xymon 844K Mar 27 15:53 sar.rrd
-rw-r--r--    1 xymon xymon 213K Mar 27 15:56 tcp.conn.rrd
-rw-r--r--    1 xymon xymon 213K Mar 27 15:26 users.rrd

TIA!

david

~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~
David Mills
Systems Administrator
Northrop Grumman
(512) 595-1238 (mobile)


_______________________________________________
Xymon mailing list
Xymon at xymon.com<mailto:Xymon at xymon.com>
http://lists.xymon.com/mailman/listinfo/xymon

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.xymon.com/pipermail/xymon/attachments/20180328/118fe434/attachment.html>