Trouble starting ext test to rrd, graph

6 messages in this thread

list Josh Luthman · Tue, 6 Jul 2021 09:28:08 -0400 ·

I wrote a script that will pull out a few lines of unbound stats and that
submission appears good.  I've got a green column by the host on the Xymon
server.  The web page is showing this:

totalnumqueries:51
totalnumqueries_ip_ratelimited:0
totalnumcachehits:22
totalnumcachemiss:29
totalrecursiontimeavg:0075215
numquerytcp:0
numquerytcpout:0
numanswerrcodeSERVFAIL:0
unwantedqueries:0
unwantedreplies:0

The part where I'm stuck at is that it won't generate RRD files.  From the
help page it suggests  Ijust add a value to TEST2RRD and NCV_ like I've
done here:

TEST2RRD="<allTheDefaultsHere>,unboundstats=ncv"

NCV_unboundstats="totalnumqueries:GAUGE,totalnumqueries_ip_ratelimited:GAUGE,totalnumcachehits:GAUGE,totalnumcachemiss:GAUGE,totalrecursiontimeavg:GAUGE,numquerytcp:GAUGE,numquerytcpout:GAUGE,numanswerrcode.SERVFAIL:GAUGE,unwantedqueries:GAUGE,unwantedreplies:GAUGE"

Something odd I did notice was that the link to the graphs (which have no
images, no rrd, etc) will say "No DS called 'inodecache' in
'unboundstats.rrd'".  What is the reference to inodecache?

I have restarted it with xymonlaunch on the server.

Now the data/rrd/ directory doesn't contain a host dir, I'm pretty sure
that is something that will be created by Xymon.

Any idea what I'm doing wrong?

Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX

list Scot Kreienkamp · Tue, 6 Jul 2021 16:28:45 +0000 ·

I create a new file in xymonserver.cfg.d so I can isolate all my configs.  Here?s one of mine that works:


TEST2RRD="$TEST2RRD,E1Evt=ncv"

GRAPHS="$GRAPHS,E1Evt"

SPLITNCV_E1Evt="*:GAUGE"


SPLITNCV puts them in different files so if you add or remove stats later you don?t lose all your history, and you can use wildcards for the type.  Other than that I don?t have any suggestions.


Scot Kreienkamp | Senior Systems Engineer | La-Z-Boy Corporate
One La-Z-Boy Drive | Monroe, Michigan 48162 | ? XXX-XXX-XXXX | |  ? X-XXX-XXX-XXXX  | ? user-9678697f1438@xymon.invalid
www.la-z-boy.com<http://www.la-z-boy.com>;  | facebook.com/lazboy<http://facebook.com/lazboy>;  | twitter.com/lazboy<http://twitter.com/lazboy>; | youtube.com/lazboy<http://youtube.com/lazboy>;
[cid:4C-lzbVertical_Tag_400px_d8b9412e-f3ea-46a1-99dc-a7c57261e11e.jpg]
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Josh Luthman
Sent: Tuesday, July 6, 2021 9:28 AM
To: Xymon MailingList <xymon at xymon.com>
Subject: [Xymon] Trouble starting ext test to rrd, graph

ATTENTION:   This email was sent to La-Z-Boy from an external source.     Be vigilant when opening attachments or clicking links.

▸ quoted from Josh Luthman

I wrote a script that will pull out a few lines of unbound stats and that submission appears good.  I've got a green column by the host on the Xymon server.  The web page is showing this:

totalnumqueries:51
totalnumqueries_ip_ratelimited:0
totalnumcachehits:22
totalnumcachemiss:29
totalrecursiontimeavg:0075215
numquerytcp:0
numquerytcpout:0
numanswerrcodeSERVFAIL:0
unwantedqueries:0
unwantedreplies:0

The part where I'm stuck at is that it won't generate RRD files.  From the help page it suggests  Ijust add a value to TEST2RRD and NCV_ like I've done here:

TEST2RRD="<allTheDefaultsHere>,unboundstats=ncv"

NCV_unboundstats="totalnumqueries:GAUGE,totalnumqueries_ip_ratelimited:GAUGE,totalnumcachehits:GAUGE,totalnumcachemiss:GAUGE,totalrecursiontimeavg:GAUGE,numquerytcp:GAUGE,numquerytcpout:GAUGE,numanswerrcode.SERVFAIL:GAUGE,unwantedqueries:GAUGE,unwantedreplies:GAUGE"

Something odd I did notice was that the link to the graphs (which have no images, no rrd, etc) will say "No DS called 'inodecache' in 'unboundstats.rrd'".  What is the reference to inodecache?

I have restarted it with xymonlaunch on the server.

Now the data/rrd/ directory doesn't contain a host dir, I'm pretty sure that is something that will be created by Xymon.

Any idea what I'm doing wrong?

Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX


This message is intended only for the individual or entity to which it is addressed. It may contain privileged, confidential information which is exempt from disclosure under applicable laws. If you are not the intended recipient, you are strictly prohibited from disseminating or distributing this information (other than to the intended recipient) or copying this information. If you have received this communication in error, please notify us immediately by e-mail or by telephone at the above number. Thank you.

list Fabian Wendlandt · Tue, 6 Jul 2021 17:02:18 +0000 ·

Hi Josh,

Something odd I did notice was that the link to the graphs (which have no images, no rrd, etc) will say "No DS called 'inodecache' in 'unboundstats.rrd'".  What is the reference to inodecache?

 
I guess you took the graph definition from this guide (https://xymon.sourceforge.io/xymon/help/howtograph.html)?

 
        [slab]

               TITLE Slab info

               YAXIS Bytes

               DEF:inode=slab.rrd:inodecache:AVERAGE

               DEF:dentry=slab.rrd:dentrycache:AVERAGE

               LINE2:inode#00CCCC:Inode cache

               LINE2:dentry#FF0000:Dentry cache

               COMMENT:\n

               GPRINT:inode:LAST:Inode cache \: %5.1lf%s (cur)

               GPRINT:inode:MAX: \: %5.1lf%s (max)

               GPRINT:inode:MIN: \: %5.1lf%s (min)

               GPRINT:inode:AVERAGE: \: %5.1lf%s (avg)\n

               GPRINT:dentry:LAST:Dentry cache\: %5.1lf%s (cur)

               GPRINT:dentry:MAX: \: %5.1lf%s (max)

               GPRINT:dentry:MIN: \: %5.1lf%s (min)

               GPRINT:dentry:AVERAGE: \: %5.1lf%s (avg)\n

 
On the lines starting with ?DEF? you can see references to the data sources (DS) ?inodecache? and ?dentrycache?, these will have different names in your case, e.g. ?totalnumqueries?.

You can use the ?rrdtool dump? command to show the data sources contained in your rrd file, if I remember correctly some of your data sources will be truncated by Xymon, e.g. totalnumqueries_ip_ratelimited might be too long.

If you now what your DSs are called, you?ll have to edit the graph definition to reference the actual names, e.g.:

 
        [unboundstats]

               TITLE Unbound Stats

               YAXIS Num

               DEF:numqueries=unboundstats.rrd:totalnumqueries:AVERAGE

               DEF:numcachehits=unboundstats.rrd:totalnumcachehits:AVERAGE

               LINE2:numqueries#00CCCC:Total Queries

               LINE2:numcachehits#FF0000:Total Cache Hits

               COMMENT:\n

               GPRINT:numqueries:LAST:Inode cache \: %5.1lf%s (cur)

               GPRINT:numqueries:MAX: \: %5.1lf%s (max)

               GPRINT:numqueries:MIN: \: %5.1lf%s (min)

               GPRINT:numqueries:AVERAGE: \: %5.1lf%s (avg)\n

               GPRINT:numcachehits:LAST:Dentry cache\: %5.1lf%s (cur)

               GPRINT:numcachehits:MAX: \: %5.1lf%s (max)

               GPRINT:numcachehits:MIN: \: %5.1lf%s (min)

               GPRINT:numcachehits:AVERAGE: \: %5.1lf%s (avg)\n

 
You?ll need to define one DEF-line for each value you want to display on the graph (DEF:<Alias for further processing>=<rrd file name>:<data source name>:<consolidation function>).

 
Best regards,

Fabian

▸ quoted from Josh Luthman


 
Von: Xymon <xymon-bounces at xymon.com> Im Auftrag von Josh Luthman
Gesendet: Dienstag, 6. Juli 2021 15:28
An: Xymon MailingList <xymon at xymon.com>
Betreff: [Xymon] Trouble starting ext test to rrd, graph

 
I wrote a script that will pull out a few lines of unbound stats and that submission appears good.  I've got a green column by the host on the Xymon server.  The web page is showing this:

 
totalnumqueries:51
totalnumqueries_ip_ratelimited:0
totalnumcachehits:22
totalnumcachemiss:29
totalrecursiontimeavg:0075215
numquerytcp:0
numquerytcpout:0
numanswerrcodeSERVFAIL:0
unwantedqueries:0
unwantedreplies:0

 
The part where I'm stuck at is that it won't generate RRD files.  From the help page it suggests  Ijust add a value to TEST2RRD and NCV_ like I've done here:

 
TEST2RRD="<allTheDefaultsHere>,unboundstats=ncv"

NCV_unboundstats="totalnumqueries:GAUGE,totalnumqueries_ip_ratelimited:GAUGE,totalnumcachehits:GAUGE,totalnumcachemiss:GAUGE,totalrecursiontimeavg:GAUGE,numquerytcp:GAUGE,numquerytcpout:GAUGE,numanswerrcode.SERVFAIL:GAUGE,unwantedqueries:GAUGE,unwantedreplies:GAUGE"

 
Something odd I did notice was that the link to the graphs (which have no images, no rrd, etc) will say "No DS called 'inodecache' in 'unboundstats.rrd'".  What is the reference to inodecache?

 
I have restarted it with xymonlaunch on the server.

 
Now the data/rrd/ directory doesn't contain a host dir, I'm pretty sure that is something that will be created by Xymon. 

 
Any idea what I'm doing wrong?

 
Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX

list Jeremy Laidman · Thu, 8 Jul 2021 21:11:06 +1000 ·

A couple of things:

* RRD has a DS name length limit of 19 characters, so some of your longer
names (numanswerrcodeSERVFAIL) are going to be truncated or possibly even
cause the whole lot to be rejected. Also, there's a restriction on
characters that can be used: [a-zA-Z0-9_]

* In your webpage output you use numanswerrcodeSERVFAIL but in your NCV_
setting you have numanswerrcode.SERVFAIL (with a dot before SERVFAIL). I
suspect these have to be identical to work. Also, you can't use dots in DS
names as per the last point.

Cheers
Jeremy

On Tue, 6 Jul 2021 at 23:28, Josh Luthman <user-4c45a83f15cb@xymon.invalid>

▸ quoted from Fabian Wendlandt

wrote:

I wrote a script that will pull out a few lines of unbound stats and that
submission appears good.  I've got a green column by the host on the Xymon
server.  The web page is showing this:

totalnumqueries:51
totalnumqueries_ip_ratelimited:0
totalnumcachehits:22
totalnumcachemiss:29
totalrecursiontimeavg:0075215
numquerytcp:0
numquerytcpout:0
numanswerrcodeSERVFAIL:0
unwantedqueries:0
unwantedreplies:0

The part where I'm stuck at is that it won't generate RRD files.  From the
help page it suggests  Ijust add a value to TEST2RRD and NCV_ like I've
done here:

TEST2RRD="<allTheDefaultsHere>,unboundstats=ncv"


NCV_unboundstats="totalnumqueries:GAUGE,totalnumqueries_ip_ratelimited:GAUGE,totalnumcachehits:GAUGE,totalnumcachemiss:GAUGE,totalrecursiontimeavg:GAUGE,numquerytcp:GAUGE,numquerytcpout:GAUGE,numanswerrcode.SERVFAIL:GAUGE,unwantedqueries:GAUGE,unwantedreplies:GAUGE"

Something odd I did notice was that the link to the graphs (which have no
images, no rrd, etc) will say "No DS called 'inodecache' in
'unboundstats.rrd'".  What is the reference to inodecache?

I have restarted it with xymonlaunch on the server.

Now the data/rrd/ directory doesn't contain a host dir, I'm pretty sure
that is something that will be created by Xymon.

Any idea what I'm doing wrong?

Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX

list Josh Luthman · Thu, 8 Jul 2021 16:37:00 -0400 ·

Thanks a ton for the help!  It looks like between xymon config and RRD
they're simply truncated and stripped of non alphanumeric characters.
(example:  totalnumqueries_ip_ratelimited) This is in the RRD (:

# rrdtool info unboundstats.rrd
<snip>
ds[totalnumqueries].last_ds = "109"
ds[totalnumqueries].value = 8.4000000000e+00
ds[totalnumqueries].unknown_sec = 0
ds[*totalnumqueriesipra*].index = 1
ds[totalnumqueriesipra].type = "DERIVE"
ds[totalnumqueriesipra].minimal_heartbeat = 600
<snip>

My RRD are actually in /var/lib/xymon/rrd *NOT* /var/lib/xymon/data/rrd so
they were actually being made. I was looking in the wrong place (guide
doesn't match my RPM).

Per the suggestion, I decided to split them using SPLITNCV.  Honestly I
don't see why you wouldn't just do this from the get go, it's so much
easier and better.

[image: image.png]

▸ signature


Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX

▸ quoted from Jeremy Laidman

On Thu, Jul 8, 2021 at 7:11 AM Jeremy Laidman <user-0608abae5e7c@xymon.invalid> wrote:

A couple of things:

* RRD has a DS name length limit of 19 characters, so some of your longer
names (numanswerrcodeSERVFAIL) are going to be truncated or possibly even
cause the whole lot to be rejected. Also, there's a restriction on
characters that can be used: [a-zA-Z0-9_]

* In your webpage output you use numanswerrcodeSERVFAIL but in your NCV_
setting you have numanswerrcode.SERVFAIL (with a dot before SERVFAIL). I
suspect these have to be identical to work. Also, you can't use dots in DS
names as per the last point.

Cheers
Jeremy

On Tue, 6 Jul 2021 at 23:28, Josh Luthman <user-4c45a83f15cb@xymon.invalid>
wrote:

I wrote a script that will pull out a few lines of unbound stats and that
submission appears good.  I've got a green column by the host on the Xymon
server.  The web page is showing this:

totalnumqueries:51
totalnumqueries_ip_ratelimited:0
totalnumcachehits:22
totalnumcachemiss:29
totalrecursiontimeavg:0075215
numquerytcp:0
numquerytcpout:0
numanswerrcodeSERVFAIL:0
unwantedqueries:0
unwantedreplies:0

The part where I'm stuck at is that it won't generate RRD files.  From
the help page it suggests  Ijust add a value to TEST2RRD and NCV_ like I've
done here:

TEST2RRD="<allTheDefaultsHere>,unboundstats=ncv"


NCV_unboundstats="totalnumqueries:GAUGE,totalnumqueries_ip_ratelimited:GAUGE,totalnumcachehits:GAUGE,totalnumcachemiss:GAUGE,totalrecursiontimeavg:GAUGE,numquerytcp:GAUGE,numquerytcpout:GAUGE,numanswerrcode.SERVFAIL:GAUGE,unwantedqueries:GAUGE,unwantedreplies:GAUGE"

Something odd I did notice was that the link to the graphs (which have no
images, no rrd, etc) will say "No DS called 'inodecache' in
'unboundstats.rrd'".  What is the reference to inodecache?

I have restarted it with xymonlaunch on the server.

Now the data/rrd/ directory doesn't contain a host dir, I'm pretty sure
that is something that will be created by Xymon.

Any idea what I'm doing wrong?

Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX

Attachments (1)

attachment.png image/png · 41.8 KB

list Josh Luthman · Fri, 9 Jul 2021 10:13:14 -0400 ·

In case anyone else would like to do this or would appreciate an example (I
know I sure would have :) I wrote this page:

http://ram.iam8up.com/?p=72

▸ quoted from Josh Luthman


Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX


On Thu, Jul 8, 2021 at 4:37 PM Josh Luthman <user-4c45a83f15cb@xymon.invalid>

▸ quoted from Josh Luthman

wrote:

Thanks a ton for the help!  It looks like between xymon config and RRD
they're simply truncated and stripped of non alphanumeric characters.
(example:  totalnumqueries_ip_ratelimited) This is in the RRD (:

# rrdtool info unboundstats.rrd
<snip>
ds[totalnumqueries].last_ds = "109"
ds[totalnumqueries].value = 8.4000000000e+00
ds[totalnumqueries].unknown_sec = 0
ds[*totalnumqueriesipra*].index = 1
ds[totalnumqueriesipra].type = "DERIVE"
ds[totalnumqueriesipra].minimal_heartbeat = 600
<snip>

My RRD are actually in /var/lib/xymon/rrd *NOT* /var/lib/xymon/data/rrd so
they were actually being made. I was looking in the wrong place (guide
doesn't match my RPM).

Per the suggestion, I decided to split them using SPLITNCV.  Honestly I
don't see why you wouldn't just do this from the get go, it's so much
easier and better.

[image: image.png]

Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX


On Thu, Jul 8, 2021 at 7:11 AM Jeremy Laidman <user-0608abae5e7c@xymon.invalid> wrote:

A couple of things:

* RRD has a DS name length limit of 19 characters, so some of your longer
names (numanswerrcodeSERVFAIL) are going to be truncated or possibly even
cause the whole lot to be rejected. Also, there's a restriction on
characters that can be used: [a-zA-Z0-9_]

* In your webpage output you use numanswerrcodeSERVFAIL but in your NCV_
setting you have numanswerrcode.SERVFAIL (with a dot before SERVFAIL). I
suspect these have to be identical to work. Also, you can't use dots in DS
names as per the last point.

Cheers
Jeremy

On Tue, 6 Jul 2021 at 23:28, Josh Luthman <user-4c45a83f15cb@xymon.invalid>
wrote:

I wrote a script that will pull out a few lines of unbound stats and
that submission appears good.  I've got a green column by the host on the
Xymon server.  The web page is showing this:

totalnumqueries:51
totalnumqueries_ip_ratelimited:0
totalnumcachehits:22
totalnumcachemiss:29
totalrecursiontimeavg:0075215
numquerytcp:0
numquerytcpout:0
numanswerrcodeSERVFAIL:0
unwantedqueries:0
unwantedreplies:0

The part where I'm stuck at is that it won't generate RRD files.  From
the help page it suggests  Ijust add a value to TEST2RRD and NCV_ like I've
done here:

TEST2RRD="<allTheDefaultsHere>,unboundstats=ncv"


NCV_unboundstats="totalnumqueries:GAUGE,totalnumqueries_ip_ratelimited:GAUGE,totalnumcachehits:GAUGE,totalnumcachemiss:GAUGE,totalrecursiontimeavg:GAUGE,numquerytcp:GAUGE,numquerytcpout:GAUGE,numanswerrcode.SERVFAIL:GAUGE,unwantedqueries:GAUGE,unwantedreplies:GAUGE"

Something odd I did notice was that the link to the graphs (which have
no images, no rrd, etc) will say "No DS called 'inodecache' in
'unboundstats.rrd'".  What is the reference to inodecache?

I have restarted it with xymonlaunch on the server.

Now the data/rrd/ directory doesn't contain a host dir, I'm pretty sure
that is something that will be created by Xymon.

Any idea what I'm doing wrong?

Josh Luthman
24/7 Help Desk: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX

Trouble starting ext test to rrd, graph 🔗 link

Trouble starting ext test to rrd, graph