Big RRD files causing problems
list David Mills
Hi! Since upgrading to a new Xymon ( 4.3.28-1.el6.terabithia<http://xymon.sourceforge.net/>; / Linux from 4.3.3 on Solaris ) , my RRD file storage consumption is *much* greater than on the old server. It's gotten so I have to manually groom the RRD files every 48 hours or they overflow the file system. Here are some stats: NOTE: Same set of hosts with same tests on both the old server (4.3.3 / Solaris) and the Terabithia distro for RHEL 6: Picking out the current biggest offender (the list varies but tracks pretty much along the lines of the largest hosts with the most data to send): NEW Server OLD Server Total space consumed for .../rrd 90GB 14GB # of files beneath .../rrd/pwow706/ 1,916 25,815 Avg file size (eyeballing it) 423K 38K Any ideas? Where can I read up on what RRD files Xymon puts into the RRD directory? Thx! ;-) David Mills ~~~~~~~~~~~~~~~~~~~~~~~~ System Administrator Northrop Grumman Texas Health and Human Services Commission
list Jeremy Laidman
David RRD files are fixed in size - they never grow. The only grooming that would need to be repeated periodically, would be RRD filenames that are dynamic in nature. These are for things such as mounted filesystems, which can change over time (but usually don't), and for tracked logfile linecounts where the logfilenames are populated by backticks. These types of dynamic RRD files typically have commas in their names, such as "lines.,var,log,messages#error.rrd" or "disk,home.rrd". I can imagine a situation where an automounter magically mounts a USB stick to some random mountpoint dirname, and Xymon dutifully starts collecting data for it, but when the USB stick removed, the RRD file stays. Then the next USB stick that's inserted gets a new random mountpoint dirname, and hence a new RRD file. And so on. I would be looking for new RRD files that appear out of nowhere, or ones that have not been updated for a while, and try to find out where they come from. Cheers Jeremy On 12 September 2017 at 15:53, Mills,David (HHSC Contractor) < user-7037272ac73f@xymon.invalid> wrote:
Hi! Since upgrading to a new Xymon ( 4.3.28-1.el6.terabithia <http://xymon.sourceforge.net/>; / Linux from 4.3.3 on Solaris ) , my RRD
▸
file storage consumption is **much** greater than on the old server. It’s
gotten so I have to manually groom the RRD files every 48 hours or they
overflow the file system. Here are some stats:
NOTE: Same set of hosts with same tests on both the old server (4.3.3 /
Solaris) and the Terabithia distro for RHEL 6:
Picking out the current biggest offender (the list varies but tracks
pretty much along the lines of the largest hosts with the most data to
send):
NEW Server OLD Server
Total space consumed for …/rrd 90GB 14GB
# of files beneath …/rrd/pwow706/ 1,916 25,815
Avg file size (eyeballing it) 423K 38K
Any ideas?
Where can I read up on what RRD files Xymon puts into the RRD directory?
Thx!
;-)
▸
David Mills
~~~~~~~~~~~~~~~~~~~~~~~~
System Administrator
Northrop Grumman
Texas Health and Human Services Commission
list David Mills
Thx, Jeremy! ~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~ David Mills Systems Administrator Northrop Grumman (XXX) XXX-XXXX (mobile)
▸
From: Jeremy Laidman [mailto:user-71895fb2e44c@xymon.invalid] Sent: Wednesday, November 8, 2017 9:20 PM To: Mills,David (HHSC Contractor) <user-7037272ac73f@xymon.invalid> Cc: xymon at xymon.com Subject: Re: [Xymon] Big RRD files causing problems David RRD files are fixed in size - they never grow. The only grooming that would need to be repeated periodically, would be RRD filenames that are dynamic in nature. These are for things such as mounted filesystems, which can change over time (but usually don't), and for tracked logfile linecounts where the logfilenames are populated by backticks. These types of dynamic RRD files typically have commas in their names, such as "lines.,var,log,messages#error.rrd" or "disk,home.rrd". I can imagine a situation where an automounter magically mounts a USB stick to some random mountpoint dirname, and Xymon dutifully starts collecting data for it, but when the USB stick removed, the RRD file stays. Then the next USB stick that's inserted gets a new random mountpoint dirname, and hence a new RRD file. And so on. I would be looking for new RRD files that appear out of nowhere, or ones that have not been updated for a while, and try to find out where they come from. Cheers Jeremy On 12 September 2017 at 15:53, Mills,David (HHSC Contractor) <user-7037272ac73f@xymon.invalid<mailto:user-7037272ac73f@xymon.invalid>> wrote: Hi! Since upgrading to a new Xymon ( 4.3.28-1.el6.terabithia<http://xymon.sourceforge.net/>; / Linux from 4.3.3 on Solaris ) , my RRD file storage consumption is *much* greater than on the old server. It’s gotten so I have to manually groom the RRD files every 48 hours or they overflow the file system. Here are some stats: NOTE: Same set of hosts with same tests on both the old server (4.3.3 / Solaris) and the Terabithia distro for RHEL 6: Picking out the current biggest offender (the list varies but tracks pretty much along the lines of the largest hosts with the most data to send): NEW Server OLD Server Total space consumed for …/rrd 90GB 14GB # of files beneath …/rrd/pwow706/ 1,916 25,815 Avg file size (eyeballing it) 423K 38K Any ideas? Where can I read up on what RRD files Xymon puts into the RRD directory? Thx!
;-)
▸
David Mills
~~~~~~~~~~~~~~~~~~~~~~~~
System Administrator
Northrop Grumman
Texas Health and Human Services Commission