Xymon Mailing List Archive search

Graphing in Xymon

30 messages in this thread

list Paul Root · Wed, 4 Sep 2019 17:59:04 +0000 ·
I've got a new test that I need to graph. It is a simple count of devices in multiple "networks".  This test only runs once a day.   I haven't done a graph in xymon in several years, and it's always a struggle.

This is the input data:

Net_AtoD: 5871
Net_EtoN: 5589
Net_OtoZ_1to9: 5242
Other: 386
InfraGen: 12
InfraSec: 25


The data comes in fine. And I get a good rrd file (all 6 networks are in there and look the same as this, except obviously the last_ds and value values:
      <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 600 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 5871 </last_ds>
                <value> 5.8710000000e+04 </value>
                <unknown_sec> 267 </unknown_sec>
        </ds>


I have multiple xymon servers, and I share most of the config with an include line in xymonserver.cfg:

/etc/xymon/xymonserver-common.cfg:TEST2RRD+=",proc-mem-cfgmgrd=ncv,ucf=ncv,ConfigPulls=ncv"
/etc/xymon/xymonserver-common.cfg:GRAPHS+=",vmwarevms,hpnasnaphost,ucf,ConfigPulls"
/etc/xymon/xymonserver-common.cfg:NCV_ConfigPulls="*:GAUGE"

I've restarted a few times.

I put the graph config in its own file /etc/xymon/graph.d/ConfigPulls.cfg
[ConfigPulls]
        TITLE NCM Config PUlls
        YAXIS Number of Devices
        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE
        DEF:NetEtoN=ConfigPulls.rrd:EtoN:AVERAGE
        DEF:NetOtoZ=ConfigPulls.rrd:OtoZ:AVERAGE
        DEF:Other=ConfigPUlls.rrd:Other:AVERAGE
        DEF:InfraGen=ConfigPUlls.rrd:InfraGen:AVERAGE
        DEF:InfraSec=ConfigPUlls.rrd:InfraSec:AVERAGE
        LINE2:AtoD#00FF00:Net A to D
        LINE2:EtoN#00CCCC:Net E to N
        LINE2:OtoZ#FFCC00:Net O to Z & 1 to 9
        LINE2:Government#FF0000:Government
        LINE2:InfraGen#FFFF00:Infrastructure General
        LINE2:InfraSec#FFFFCC:Infrastructure Secure
        COMMENT:\n
        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)
        GPRINT:AtoD:MAX: \: %5.1lf (max)
        GPRINT:AtoD:MIN: \: %5.1lf (min)
        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:EtoN:LAST:Net E to N \: %5.1lf (cur)
        GPRINT:EtoN:MAX: \: %5.1lf (max)
        GPRINT:EtoN:MIN: \: %5.1lf (min)
        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:OtoZ:LAST:Net 0 to Z \: %5.1lf (cur)
        GPRINT:OtoZ:MAX: \: %5.1lf (max)
        GPRINT:OtoZ:MIN: \: %5.1lf (min)
        GPRINT:OtoZ:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:Government:LAST:Government \: %5.1lf (cur)
        GPRINT:Government:MAX: \: %5.1lf (max)
        GPRINT:Government:MIN: \: %5.1lf (min)
        GPRINT:Government:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:InfraGen:LAST:Infrastructure General \: %5.1lf (cur)
        GPRINT:InfraGen:MAX: \: %5.1lf (max)
        GPRINT:InfraGen:MIN: \: %5.1lf (min)
        GPRINT:InfraGen:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:InfraSec:LAST:Infrastructure Secure \: %5.1lf (cur)
        GPRINT:InfraSec:MAX: \: %5.1lf (max)
        GPRINT:InfraSec:MIN: \: %5.1lf (min)
        GPRINT:InfraSec:AVERAGE: \: %5.1lf (avg)\n


The graph doesn't show up, just a broken link in both the test and trends pages.


Any help?

Thanks,
Paul.


Paul Root
Lead Operations Engineer    - IT Managed Services
XXX Commerce Dr
Woodbury, Mn 55125
XXX-XXX-XXXX  user-76fdb6883669@xymon.invalid

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Ralph Mitchell · Wed, 4 Sep 2019 14:21:48 -0400 ·
I think maybe your names don't match??

     <ds>

                <name> NetAtoD </name>


not equal to:


        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE

        .....

        LINE2:AtoD#00FF00:Net A to D

        .....

        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)


I think it should be:


       DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE

       ....

        LINE2:NetAtoD#00FF00:Net A to D

        ....

        GPRINT:NetAtoD:LAST:Net A to D \: %5.1lf (cur)


and similarly for the other DEF, LINE2 and GPRINT.  It's been a long time
since I messed with graphs too, so I could be completely wrong.


Ralph Mitchell


On Wed, Sep 4, 2019 at 1:59 PM Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
I?ve got a new test that I need to graph. It is a simple count of devices
in multiple ?networks?.  This test only runs once a day.   I haven?t done
a graph in xymon in several years, and it?s always a struggle.


This is the input data:


Net_AtoD: 5871
Net_EtoN: 5589
Net_OtoZ_1to9: 5242
Other: 386
InfraGen: 12
InfraSec: 25


The data comes in fine. And I get a good rrd file (all 6 networks are in
there and look the same as this, except obviously the last_ds and value
values:

      <ds>

                <name> NetAtoD </name>

                <type> GAUGE </type>

                <minimal_heartbeat> 600 </minimal_heartbeat>

                <min> NaN </min>

                <max> NaN </max>


                <!-- PDP Status -->

                <last_ds> 5871 </last_ds>

                <value> 5.8710000000e+04 </value>

                <unknown_sec> 267 </unknown_sec>

        </ds>


I have multiple xymon servers, and I share most of the config with an
include line in xymonserver.cfg:


/etc/xymon/xymonserver-common.cfg:TEST2RRD+=",proc-mem-cfgmgrd=ncv,ucf=ncv,ConfigPulls=ncv"


/etc/xymon/xymonserver-common.cfg:GRAPHS+=",vmwarevms,hpnasnaphost,ucf,ConfigPulls"

/etc/xymon/xymonserver-common.cfg:NCV_ConfigPulls="*:GAUGE"


I?ve restarted a few times.


I put the graph config in its own file /etc/xymon/graph.d/ConfigPulls.cfg

[ConfigPulls]

        TITLE NCM Config PUlls

        YAXIS Number of Devices

        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE

        DEF:NetEtoN=ConfigPulls.rrd:EtoN:AVERAGE

        DEF:NetOtoZ=ConfigPulls.rrd:OtoZ:AVERAGE

        DEF:Other=ConfigPUlls.rrd:Other:AVERAGE

        DEF:InfraGen=ConfigPUlls.rrd:InfraGen:AVERAGE

        DEF:InfraSec=ConfigPUlls.rrd:InfraSec:AVERAGE

        LINE2:AtoD#00FF00:Net A to D

        LINE2:EtoN#00CCCC:Net E to N

        LINE2:OtoZ#FFCC00:Net O to Z & 1 to 9

        LINE2:Government#FF0000:Government

        LINE2:InfraGen#FFFF00:Infrastructure General

        LINE2:InfraSec#FFFFCC:Infrastructure Secure

        COMMENT:\n

        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)

        GPRINT:AtoD:MAX: \: %5.1lf (max)

        GPRINT:AtoD:MIN: \: %5.1lf (min)

        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:EtoN:LAST:Net E to N \: %5.1lf (cur)

        GPRINT:EtoN:MAX: \: %5.1lf (max)

        GPRINT:EtoN:MIN: \: %5.1lf (min)

        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:OtoZ:LAST:Net 0 to Z \: %5.1lf (cur)

        GPRINT:OtoZ:MAX: \: %5.1lf (max)

        GPRINT:OtoZ:MIN: \: %5.1lf (min)

        GPRINT:OtoZ:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:Government:LAST:Government \: %5.1lf (cur)

        GPRINT:Government:MAX: \: %5.1lf (max)

        GPRINT:Government:MIN: \: %5.1lf (min)

        GPRINT:Government:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:InfraGen:LAST:Infrastructure General \: %5.1lf (cur)

        GPRINT:InfraGen:MAX: \: %5.1lf (max)

        GPRINT:InfraGen:MIN: \: %5.1lf (min)

        GPRINT:InfraGen:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:InfraSec:LAST:Infrastructure Secure \: %5.1lf (cur)

        GPRINT:InfraSec:MAX: \: %5.1lf (max)

        GPRINT:InfraSec:MIN: \: %5.1lf (min)

        GPRINT:InfraSec:AVERAGE: \: %5.1lf (avg)\n


The graph doesn?t show up, just a broken link in both the test and trends
pages.


Any help?


Thanks,

Paul.


Paul Root

Lead Operations Engineer    - IT Managed Services

XXX Commerce Dr

Woodbury, Mn 55125

XXX-XXX-XXXX  user-76fdb6883669@xymon.invalid


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.

list Paul Root · Wed, 4 Sep 2019 19:00:10 +0000 ·
Ah, thanks. I?ll give that a try. I was going quick and thinking I was relating a file to a field, and then putting a label in.
quoted from Ralph Mitchell

From: Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
Sent: Wednesday, September 04, 2019 1:22 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

I think maybe your names don't match??

     <ds>
                <name> NetAtoD </name>

not equal to:

        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE
        .....
        LINE2:AtoD#00FF00:Net A to D
        .....
        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)


I think it should be:

       DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE
       ....
        LINE2:NetAtoD#00FF00:Net A to D
        ....
        GPRINT:NetAtoD:LAST:Net A to D \: %5.1lf (cur)

and similarly for the other DEF, LINE2 and GPRINT.  It's been a long time since I messed with graphs too, so I could be completely wrong.

Ralph Mitchell


On Wed, Sep 4, 2019 at 1:59 PM Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
I?ve got a new test that I need to graph. It is a simple count of devices in multiple ?networks?.  This test only runs once a day.   I haven?t done a graph in xymon in several years, and it?s always a struggle.

This is the input data:

Net_AtoD: 5871
Net_EtoN: 5589
Net_OtoZ_1to9: 5242
Other: 386
InfraGen: 12
InfraSec: 25


The data comes in fine. And I get a good rrd file (all 6 networks are in there and look the same as this, except obviously the last_ds and value values:
      <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 600 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 5871 </last_ds>
                <value> 5.8710000000e+04 </value>
                <unknown_sec> 267 </unknown_sec>
        </ds>


I have multiple xymon servers, and I share most of the config with an include line in xymonserver.cfg:

/etc/xymon/xymonserver-common.cfg:TEST2RRD+=",proc-mem-cfgmgrd=ncv,ucf=ncv,ConfigPulls=ncv"
/etc/xymon/xymonserver-common.cfg:GRAPHS+=",vmwarevms,hpnasnaphost,ucf,ConfigPulls"
/etc/xymon/xymonserver-common.cfg:NCV_ConfigPulls="*:GAUGE"

I?ve restarted a few times.

I put the graph config in its own file /etc/xymon/graph.d/ConfigPulls.cfg
[ConfigPulls]
        TITLE NCM Config PUlls
        YAXIS Number of Devices
        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE
        DEF:NetEtoN=ConfigPulls.rrd:EtoN:AVERAGE
        DEF:NetOtoZ=ConfigPulls.rrd:OtoZ:AVERAGE
        DEF:Other=ConfigPUlls.rrd:Other:AVERAGE
        DEF:InfraGen=ConfigPUlls.rrd:InfraGen:AVERAGE
        DEF:InfraSec=ConfigPUlls.rrd:InfraSec:AVERAGE
        LINE2:AtoD#00FF00:Net A to D
        LINE2:EtoN#00CCCC:Net E to N
        LINE2:OtoZ#FFCC00:Net O to Z & 1 to 9
        LINE2:Government#FF0000:Government
        LINE2:InfraGen#FFFF00:Infrastructure General
        LINE2:InfraSec#FFFFCC:Infrastructure Secure
        COMMENT:\n
        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)
        GPRINT:AtoD:MAX: \: %5.1lf (max)
        GPRINT:AtoD:MIN: \: %5.1lf (min)
        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:EtoN:LAST:Net E to N \: %5.1lf (cur)
        GPRINT:EtoN:MAX: \: %5.1lf (max)
        GPRINT:EtoN:MIN: \: %5.1lf (min)
        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:OtoZ:LAST:Net 0 to Z \: %5.1lf (cur)
        GPRINT:OtoZ:MAX: \: %5.1lf (max)
        GPRINT:OtoZ:MIN: \: %5.1lf (min)
        GPRINT:OtoZ:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:Government:LAST:Government \: %5.1lf (cur)
        GPRINT:Government:MAX: \: %5.1lf (max)
        GPRINT:Government:MIN: \: %5.1lf (min)
        GPRINT:Government:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:InfraGen:LAST:Infrastructure General \: %5.1lf (cur)
        GPRINT:InfraGen:MAX: \: %5.1lf (max)
        GPRINT:InfraGen:MIN: \: %5.1lf (min)
        GPRINT:InfraGen:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:InfraSec:LAST:Infrastructure Secure \: %5.1lf (cur)
        GPRINT:InfraSec:MAX: \: %5.1lf (max)
        GPRINT:InfraSec:MIN: \: %5.1lf (min)
        GPRINT:InfraSec:AVERAGE: \: %5.1lf (avg)\n


The graph doesn?t show up, just a broken link in both the test and trends pages.


Any help?

Thanks,
Paul.


Paul Root
Lead Operations Engineer    - IT Managed Services
XXX Commerce Dr
Woodbury, Mn 55125

XXX-XXX-XXXX  user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>
quoted from Ralph Mitchell

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Paul Root · Thu, 5 Sep 2019 16:32:49 +0000 ·
Well, this didn?t work.

I?ve removed the file from the /etc/xymon/graph.d directory, and added it directly into graphs.cfg.    No help.

I removed the comment and GPRINT lines, as they are superfluous at this time. Still nothing.

Is there a way to manually create a gif/jpg/whatever with rrdtool to test that the data will create a graph?


What I have now:
[ConfigPulls]
        TITLE NCM Config Pulls
        YAXIS Number of Devices
        DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE
        DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE
        DEF:NetOtoZ=ConfigPulls.rrd:NetOtoZ:AVERAGE
        DEF:Other=ConfigPulls.rrd:Other:AVERAGE
        DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE
        DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE


As I read the how to, the DEF is
DEF:<label you want>=<rrdfile>:<data label in the rrd file:AVERAGE

So those should be right.
quoted from Ralph Mitchell


From: Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
Sent: Wednesday, September 04, 2019 1:22 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

I think maybe your names don't match??

     <ds>
                <name> NetAtoD </name>

not equal to:

        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE
        .....
        LINE2:AtoD#00FF00:Net A to D
        .....
        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)


I think it should be:

       DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE
       ....
        LINE2:NetAtoD#00FF00:Net A to D
        ....
        GPRINT:NetAtoD:LAST:Net A to D \: %5.1lf (cur)

and similarly for the other DEF, LINE2 and GPRINT.  It's been a long time since I messed with graphs too, so I could be completely wrong.

Ralph Mitchell


On Wed, Sep 4, 2019 at 1:59 PM Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
I?ve got a new test that I need to graph. It is a simple count of devices in multiple ?networks?.  This test only runs once a day.   I haven?t done a graph in xymon in several years, and it?s always a struggle.

This is the input data:

Net_AtoD: 5871
Net_EtoN: 5589
Net_OtoZ_1to9: 5242
Other: 386
InfraGen: 12
InfraSec: 25


The data comes in fine. And I get a good rrd file (all 6 networks are in there and look the same as this, except obviously the last_ds and value values:
      <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 600 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 5871 </last_ds>
                <value> 5.8710000000e+04 </value>
                <unknown_sec> 267 </unknown_sec>
        </ds>


I have multiple xymon servers, and I share most of the config with an include line in xymonserver.cfg:

/etc/xymon/xymonserver-common.cfg:TEST2RRD+=",proc-mem-cfgmgrd=ncv,ucf=ncv,ConfigPulls=ncv"
/etc/xymon/xymonserver-common.cfg:GRAPHS+=",vmwarevms,hpnasnaphost,ucf,ConfigPulls"
/etc/xymon/xymonserver-common.cfg:NCV_ConfigPulls="*:GAUGE"

I?ve restarted a few times.

I put the graph config in its own file /etc/xymon/graph.d/ConfigPulls.cfg
[ConfigPulls]
        TITLE NCM Config PUlls
        YAXIS Number of Devices
        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE
        DEF:NetEtoN=ConfigPulls.rrd:EtoN:AVERAGE
        DEF:NetOtoZ=ConfigPulls.rrd:OtoZ:AVERAGE
        DEF:Other=ConfigPUlls.rrd:Other:AVERAGE
        DEF:InfraGen=ConfigPUlls.rrd:InfraGen:AVERAGE
        DEF:InfraSec=ConfigPUlls.rrd:InfraSec:AVERAGE
        LINE2:AtoD#00FF00:Net A to D
        LINE2:EtoN#00CCCC:Net E to N
        LINE2:OtoZ#FFCC00:Net O to Z & 1 to 9
        LINE2:Government#FF0000:Government
        LINE2:InfraGen#FFFF00:Infrastructure General
        LINE2:InfraSec#FFFFCC:Infrastructure Secure
        COMMENT:\n
        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)
        GPRINT:AtoD:MAX: \: %5.1lf (max)
        GPRINT:AtoD:MIN: \: %5.1lf (min)
        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:EtoN:LAST:Net E to N \: %5.1lf (cur)
        GPRINT:EtoN:MAX: \: %5.1lf (max)
        GPRINT:EtoN:MIN: \: %5.1lf (min)
        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:OtoZ:LAST:Net 0 to Z \: %5.1lf (cur)
        GPRINT:OtoZ:MAX: \: %5.1lf (max)
        GPRINT:OtoZ:MIN: \: %5.1lf (min)
        GPRINT:OtoZ:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:Government:LAST:Government \: %5.1lf (cur)
        GPRINT:Government:MAX: \: %5.1lf (max)
        GPRINT:Government:MIN: \: %5.1lf (min)
        GPRINT:Government:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:InfraGen:LAST:Infrastructure General \: %5.1lf (cur)
        GPRINT:InfraGen:MAX: \: %5.1lf (max)
        GPRINT:InfraGen:MIN: \: %5.1lf (min)
        GPRINT:InfraGen:AVERAGE: \: %5.1lf (avg)\n
        GPRINT:InfraSec:LAST:Infrastructure Secure \: %5.1lf (cur)
        GPRINT:InfraSec:MAX: \: %5.1lf (max)
        GPRINT:InfraSec:MIN: \: %5.1lf (min)
        GPRINT:InfraSec:AVERAGE: \: %5.1lf (avg)\n


The graph doesn?t show up, just a broken link in both the test and trends pages.


Any help?

Thanks,
Paul.


Paul Root
Lead Operations Engineer    - IT Managed Services
XXX Commerce Dr
Woodbury, Mn 55125
XXX-XXX-XXXX  user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Ralph Mitchell · Thu, 5 Sep 2019 13:43:41 -0400 ·
I got a two-line graph from the netstat.rrd by doing this:

     rrdtool graph netstat.jpg  \
          "DEF:udpInDatagrams=netstat.rrd:udpInDatagrams:AVERAGE"   \
          "LINE3:udpInDatagrams#00FF00:UDP In Datagrams"   \
          "DEF:udpOutDatagrams=netstat.rrd:udpOutDatagrams:AVERAGE"   \
          "LINE1:udpOutDatagrams#0000FF:UDP Out Datagrams"

The quoted DEF and LINE strings are directly copied from the [netstat1]
config in the graph.cfg file.

Ralph Mitchell


On Thu, Sep 5, 2019 at 12:32 PM Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
Well, this didn?t work.


I?ve removed the file from the /etc/xymon/graph.d directory, and added it
directly into graphs.cfg.    No help.


I removed the comment and GPRINT lines, as they are superfluous at this
time. Still nothing.


Is there a way to manually create a gif/jpg/whatever with rrdtool to test
that the data will create a graph?


What I have now:

[ConfigPulls]

        TITLE NCM Config Pulls

        YAXIS Number of Devices

        DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE

        DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE

        DEF:NetOtoZ=ConfigPulls.rrd:NetOtoZ:AVERAGE

        DEF:Other=ConfigPulls.rrd:Other:AVERAGE

        DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE

        DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE


As I read the how to, the DEF is

DEF:<label you want>=<rrdfile>:<data label in the rrd file:AVERAGE


So those should be right.


*From:* Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
*Sent:* Wednesday, September 04, 2019 1:22 PM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


I think maybe your names don't match??


     <ds>

                <name> NetAtoD </name>


not equal to:


        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE

        .....

        LINE2:AtoD#00FF00:Net A to D

        .....

        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)


I think it should be:


       DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE

       ....

        LINE2:NetAtoD#00FF00:Net A to D

        ....

        GPRINT:NetAtoD:LAST:Net A to D \: %5.1lf (cur)


and similarly for the other DEF, LINE2 and GPRINT.  It's been a long time
since I messed with graphs too, so I could be completely wrong.


Ralph Mitchell


On Wed, Sep 4, 2019 at 1:59 PM Root, Paul T <user-76fdb6883669@xymon.invalid>
wrote:

I?ve got a new test that I need to graph. It is a simple count of devices
in multiple ?networks?.  This test only runs once a day.   I haven?t done a
graph in xymon in several years, and it?s always a struggle.


This is the input data:


Net_AtoD: 5871
Net_EtoN: 5589
Net_OtoZ_1to9: 5242
Other: 386
InfraGen: 12
InfraSec: 25


The data comes in fine. And I get a good rrd file (all 6 networks are in
there and look the same as this, except obviously the last_ds and value
values:

      <ds>

                <name> NetAtoD </name>

                <type> GAUGE </type>

                <minimal_heartbeat> 600 </minimal_heartbeat>

                <min> NaN </min>

                <max> NaN </max>


                <!-- PDP Status -->

                <last_ds> 5871 </last_ds>

                <value> 5.8710000000e+04 </value>

                <unknown_sec> 267 </unknown_sec>

        </ds>


I have multiple xymon servers, and I share most of the config with an
include line in xymonserver.cfg:


/etc/xymon/xymonserver-common.cfg:TEST2RRD+=",proc-mem-cfgmgrd=ncv,ucf=ncv,ConfigPulls=ncv"


/etc/xymon/xymonserver-common.cfg:GRAPHS+=",vmwarevms,hpnasnaphost,ucf,ConfigPulls"

/etc/xymon/xymonserver-common.cfg:NCV_ConfigPulls="*:GAUGE"


I?ve restarted a few times.


I put the graph config in its own file /etc/xymon/graph.d/ConfigPulls.cfg

[ConfigPulls]

        TITLE NCM Config PUlls

        YAXIS Number of Devices

        DEF:NetAtoD=ConfigPulls.rrd:AtoD:AVERAGE

        DEF:NetEtoN=ConfigPulls.rrd:EtoN:AVERAGE

        DEF:NetOtoZ=ConfigPulls.rrd:OtoZ:AVERAGE

        DEF:Other=ConfigPUlls.rrd:Other:AVERAGE

        DEF:InfraGen=ConfigPUlls.rrd:InfraGen:AVERAGE

        DEF:InfraSec=ConfigPUlls.rrd:InfraSec:AVERAGE

        LINE2:AtoD#00FF00:Net A to D

        LINE2:EtoN#00CCCC:Net E to N

        LINE2:OtoZ#FFCC00:Net O to Z & 1 to 9

        LINE2:Government#FF0000:Government

        LINE2:InfraGen#FFFF00:Infrastructure General

        LINE2:InfraSec#FFFFCC:Infrastructure Secure

        COMMENT:\n

        GPRINT:AtoD:LAST:Net A to D \: %5.1lf (cur)

        GPRINT:AtoD:MAX: \: %5.1lf (max)

        GPRINT:AtoD:MIN: \: %5.1lf (min)

        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:EtoN:LAST:Net E to N \: %5.1lf (cur)

        GPRINT:EtoN:MAX: \: %5.1lf (max)

        GPRINT:EtoN:MIN: \: %5.1lf (min)

        GPRINT:EtoN:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:OtoZ:LAST:Net 0 to Z \: %5.1lf (cur)

        GPRINT:OtoZ:MAX: \: %5.1lf (max)

        GPRINT:OtoZ:MIN: \: %5.1lf (min)

        GPRINT:OtoZ:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:Government:LAST:Government \: %5.1lf (cur)

        GPRINT:Government:MAX: \: %5.1lf (max)

        GPRINT:Government:MIN: \: %5.1lf (min)

        GPRINT:Government:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:InfraGen:LAST:Infrastructure General \: %5.1lf (cur)

        GPRINT:InfraGen:MAX: \: %5.1lf (max)

        GPRINT:InfraGen:MIN: \: %5.1lf (min)

        GPRINT:InfraGen:AVERAGE: \: %5.1lf (avg)\n

        GPRINT:InfraSec:LAST:Infrastructure Secure \: %5.1lf (cur)

        GPRINT:InfraSec:MAX: \: %5.1lf (max)

        GPRINT:InfraSec:MIN: \: %5.1lf (min)

        GPRINT:InfraSec:AVERAGE: \: %5.1lf (avg)\n


The graph doesn?t show up, just a broken link in both the test and trends
pages.


Any help?


Thanks,

Paul.


Paul Root

Lead Operations Engineer    - IT Managed Services

XXX Commerce Dr

Woodbury, Mn 55125

XXX-XXX-XXXX  user-76fdb6883669@xymon.invalid


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.
list Stef Coene · Thu, 5 Sep 2019 21:17:55 +0200 ·
quoted from Ralph Mitchell
On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn?t show up, just a broken link in both the test and trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as text. But you browser expects a graph, not some text so it displays a broken image symbol.

When yoy right click on one of the broken image, you can say 'open image in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef
list Paul Root · Thu, 5 Sep 2019 19:56:47 +0000 ·
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
        --title "NCM Config Pulls" \
        "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
        "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
        "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
        "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
        "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
        "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
        "LINE2:NetAtoD#00FF00:Net A to D" \
        "LINE2:NetEtoN#00CCCC:Net E to N" \
        "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
        "LINE2:Other#FF0000:Other" \
        "LINE2:InfraGen#FFFF00:Infrastructure General" \
        "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
        "COMMENT:\n"
quoted from Stef Coene


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Japheth Cleaver · Thu, 5 Sep 2019 12:59:58 -0700 ·
A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD 
directory as expected?

Regards,
-jc
quoted from Paul Root

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
         --title "NCM Config Pulls" \
         "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
         "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
         "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
         "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
         "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
         "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
         "LINE2:NetAtoD#00FF00:Net A to D" \
         "LINE2:NetEtoN#00CCCC:Net E to N" \
         "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
         "LINE2:Other#FF0000:Other" \
         "LINE2:InfraGen#FFFF00:Infrastructure General" \
         "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
         "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

list Paul Root · Thu, 5 Sep 2019 20:16:30 +0000 ·
Ah,
        I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

        And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


        Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.
quoted from Japheth Cleaver


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
         --title "NCM Config Pulls" \
         "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
         "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
         "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
         "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
         "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
         "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
         "LINE2:NetAtoD#00FF00:Net A to D" \
         "LINE2:NetEtoN#00CCCC:Net E to N" \
         "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
         "LINE2:Other#FF0000:Other" \
         "LINE2:InfraGen#FFFF00:Infrastructure General" \
         "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
         "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Paul Root · Thu, 5 Sep 2019 20:22:40 +0000 ·
Oh, the client machine is RedHat 6 and xymon-client 4.3.28
quoted from Paul Root

-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Root, Paul T
Sent: Thursday, September 05, 2019 3:17 PM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Ah,
        I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

        And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


        Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
         --title "NCM Config Pulls" \
         "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
         "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
         "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
         "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
         "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
         "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
         "LINE2:NetAtoD#00FF00:Net A to D" \
         "LINE2:NetEtoN#00CCCC:Net E to N" \
         "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
         "LINE2:Other#FF0000:Other" \
         "LINE2:InfraGen#FFFF00:Infrastructure General" \
         "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
         "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Japheth Cleaver · Thu, 5 Sep 2019 13:33:06 -0700 ·
This is probably a sign of invalid rrdctl socket files, as that's what 
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named 
"rrdctl.<pid>", one for each of the currently running xymond_rrd 
processes (usually two,m one for status, one for data). They'll need to 
be writable by your apache user at least, and SELinux may require 
additional permissions for the sendto if you have it enabled and 
enforcing. If you see lots of stale ones, be sure to remove them -- as 
showgraph.sh doesn't know what's current, I believe it tries to cycle 
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter 
what the situation. Trying to find all cases of this is a longer term 
goal for all the CGIs.

HTH,
-jc
quoted from Paul Root

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
         I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

         And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


         Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
          --title "NCM Config Pulls" \
          "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
          "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
          "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
          "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
          "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
          "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
          "LINE2:NetAtoD#00FF00:Net A to D" \
          "LINE2:NetEtoN#00CCCC:Net E to N" \
          "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
          "LINE2:Other#FF0000:Other" \
          "LINE2:InfraGen#FFFF00:Infrastructure General" \
          "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
          "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Paul Root · Thu, 5 Sep 2019 20:48:59 +0000 ·
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.
quoted from Japheth Cleaver

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
         I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

         And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


         Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
          --title "NCM Config Pulls" \
          "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
          "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
          "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
          "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
          "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
          "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
          "LINE2:NetAtoD#00FF00:Net A to D" \
          "LINE2:NetEtoN#00CCCC:Net E to N" \
          "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
          "LINE2:Other#FF0000:Other" \
          "LINE2:InfraGen#FFFF00:Infrastructure General" \
          "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
          "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Japheth Cleaver · Thu, 5 Sep 2019 15:19:25 -0700 ·
Hmm.

That's definitely odd, but if at least some of the graphs are showing 
then it's not an overall systemic issue. Have you tried removing the 
--no-cache from the RRD calls by any chance?

-jc
quoted from Paul Root

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

          And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef
list Paul Root · Fri, 6 Sep 2019 13:27:31 +0000 ·
No difference.

I didn't restart xymon for that, just removed the --no-cache from the lines in tasks.cfg , and killed the rrd processes.
quoted from Japheth Cleaver


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

          And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Paul Root · Fri, 6 Sep 2019 13:47:26 +0000 ·
Looking in the rrd file, it doesn't seem like there are the historical data in the file.

The data is only going to change once a day, so I was only calling the script once a day.

I'm going to run the xymon script every hour to see if that gets the pump primed, and give me more data.

Does the graphing thing need more frequent data?
quoted from Paul Root


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Root, Paul T
Sent: Friday, September 06, 2019 8:28 AM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

No difference.

I didn't restart xymon for that, just removed the --no-cache from the lines in tasks.cfg , and killed the rrd processes.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

          And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Ralph Mitchell · Fri, 6 Sep 2019 11:07:15 -0400 ·
Could be wrong, but I think the graphs need two or three data points in
order to show anything.

Ralph Mitchell

On Fri, Sep 6, 2019 at 9:47 AM Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
Looking in the rrd file, it doesn't seem like there are the historical
data in the file.

The data is only going to change once a day, so I was only calling the
script once a day.

I'm going to run the xymon script every hour to see if that gets the pump
primed, and give me more data.

Does the graphing thing need more frequent data?


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Root, Paul T
Sent: Friday, September 06, 2019 8:28 AM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

No difference.

I didn't restart xymon for that, just removed the --no-cache from the
lines in tasks.cfg , and killed the rrd processes.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd
--rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd
--rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with
variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon
logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05
15:12:22.832251 Sendto failed: Connection refused, referer:
https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05
15:12:22.832306 Sendto failed: Connection refused, referer:
https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end
of script headers: showgraph.sh, referer:
https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
          And yes, the rrd file exists in the right directory. It only
has 1 data point at this time, but again. Running rrdtool graph on that
file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own
build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't
got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "
http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
"
--2019-09-05 14:46:58--
http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred
the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open
image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.

list Paul Root · Fri, 6 Sep 2019 18:01:49 +0000 ·
I don?t think the rrd file is working right.

It is there, and the latest numbers are in, but I don?t see any archive numbers populating.

Where can I check for that?
quoted from Ralph Mitchell


From: Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
Sent: Friday, September 06, 2019 10:07 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid>; Stef Coene <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Could be wrong, but I think the graphs need two or three data points in order to show anything.

Ralph Mitchell

On Fri, Sep 6, 2019 at 9:47 AM Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
Looking in the rrd file, it doesn't seem like there are the historical data in the file.

The data is only going to change once a day, so I was only calling the script once a day.

I'm going to run the xymon script every hour to see if that gets the pump primed, and give me more data.

Does the graphing thing need more frequent data?


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com<mailto:xymon-bounces at xymon.com>> On Behalf Of Root, Paul T
Sent: Friday, September 06, 2019 8:28 AM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

No difference.

I didn't restart xymon for that, just removed the --no-cache from the lines in tasks.cfg , and killed the rrd processes.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

          And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com<mailto:xymon-bounces at xymon.com>> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Japheth Cleaver · Mon, 9 Sep 2019 10:45:02 -0700 ·
You should see four different RRA's (round-robin archives) when you run 
'rrdtool info' on the actual RRD file, each being populated as "roll-up" 
averages of the various data point. For example: ]# rrdtool info clock.rrd
filename = "clock.rrd"
rrd_version = "0003"
step = 300
last_update = 1568049660
header_size = 1208
ds[la].index = 0
ds[la].type = "GAUGE"
ds[la].minimal_heartbeat = 600
ds[la].min = NaN
ds[la].max = NaN
ds[la].last_ds = "0"
ds[la].value = 0.0000000000e+00
ds[la].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 576
rra[0].cur_row = 253
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 576
rra[1].cur_row = 419
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = 0.0000000000e+00
rra[1].cdp_prep[0].unknown_datapoints = 0
rra[2].cf = "AVERAGE"
rra[2].rows = 576
rra[2].cur_row = 520
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = 0.0000000000e+00
rra[2].cdp_prep[0].unknown_datapoints = 0
rra[3].cf = "AVERAGE"
rra[3].rows = 576
rra[3].cur_row = 392
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = 3.4666666667e-01
rra[3].cdp_prep[0].unknown_datapoints = 0

I suspect the issue here is the lack of data in the originating source. 
It seems like a once-a-day datapoint should at least be made visible in 
the 2d RRA, but I've not actually tried to configure one with low 
frequency before. Would you be able to artificially submit that point 
several times within a 5m period and see if it populates? Keeping 
--no-cache back on may be beneficial here too.

Regards,
-jc
quoted from Paul Root

On 9/6/2019 11:01 AM, Root, Paul T wrote:
I don?t think the rrd file is working right.

It is there, and the latest numbers are in, but I don?t see any 
archive numbers populating.

Where can I check for that?

*From:*Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
quoted from Paul Root
*Sent:* Friday, September 06, 2019 10:07 AM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid>; Stef Coene 
<user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon

Could be wrong, but I think the graphs need two or three data points 
in order to show anything.

Ralph Mitchell

On Fri, Sep 6, 2019 at 9:47 AM Root, Paul T <user-76fdb6883669@xymon.invalid 
<mailto:user-76fdb6883669@xymon.invalid>> wrote:

    Looking in the rrd file, it doesn't seem like there are the
    historical data in the file.

    The data is only going to change once a day, so I was only calling
    the script once a day.

    I'm going to run the xymon script every hour to see if that gets
    the pump primed, and give me more data.

    Does the graphing thing need more frequent data?


    -----Original Message-----
    From: Xymon <xymon-bounces at xymon.com

    <mailto:xymon-bounces at xymon.com>> On Behalf Of Root, Paul T
    Sent: Friday, September 06, 2019 8:28 AM
    To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid
    <mailto:user-87556346d4af@xymon.invalid>>; 'Stef Coene'
    <user-dbffe946c0f4@xymon.invalid <mailto:user-dbffe946c0f4@xymon.invalid>>;
    xymon at xymon.com <mailto:xymon at xymon.com>
quoted from Paul Root
    Subject: Re: [Xymon] Graphing in Xymon

    No difference.

    I didn't restart xymon for that, just removed the --no-cache from
    the lines in tasks.cfg , and killed the rrd processes.


    -----Original Message-----
    From: Japheth Cleaver <user-87556346d4af@xymon.invalid
    Sent: Thursday, September 05, 2019 5:19 PM
    To: Root, Paul T <user-76fdb6883669@xymon.invalid

    <mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene'
    <user-dbffe946c0f4@xymon.invalid <mailto:user-dbffe946c0f4@xymon.invalid>>;
    xymon at xymon.com <mailto:xymon at xymon.com>
quoted from Paul Root
    Subject: Re: [Xymon] Graphing in Xymon

    Hmm.

    That's definitely odd, but if at least some of the graphs are showing
    then it's not an overall systemic issue. Have you tried removing the
    --no-cache from the RRD calls by any chance?

    -jc

    On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:? ? ? ? ? 2339
rrdctl.2437:? ? ? ? ? 2437
$ ps -ef |grep 2339
xymon? ? ?2339? 2323? 0 15:09 ?? ? ? ? 00:00:09 xymond_rrd
    --rrddir=/var/lib/xymon/rrd --no-cache
root? ? ? 5083? 4674? 0 15:43 pts/0? ? 00:00:00 grep 2339
$ ps -ef |grep 2437
xymon? ? ?2437? 2324? 0 15:09 ?? ? ? ? 00:00:00 xymond_rrd
    --rrddir=/var/lib/xymon/rrd --no-cache
root? ? ? 5086? 4674? 0 15:43 pts/0? ? 00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.? 2 xymon xymon? ? ?4096 Sep? 5 15:39 .
drwxr-xr-x. 12 xymon xymon? ? ?4096 Mar? 1? 2016 ..
-rw-rw-r--.? 1 xymon xymon? ? 52136 Sep? 5 15:43 alert.chk
-rw-rw-r--.? 1 xymon xymon? ? ? ?96 Sep? 5 15:43 alert.chk.sub
-rw-r--r--.? 1 xymon xymon? ? ? ?24 Sep? 5 15:39 ping..status
srw-rw-rw-.? 1 xymon xymon? ? ? ? 0 Sep? 5 15:09 rrdctl.2339
srw-rw-rw-.? 1 xymon xymon? ? ? ? 0 Sep? 5 15:09 rrdctl.2437
-rw-r--r--.? 1 xymon xymon? ? ? ?22 Oct 19? 2018 ssh_8022..status
-rw-r--r--.? 1 xymon xymon 20366660 Sep? 5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones
    with variable data points. I didn't set those up, but they are
    working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid
    <mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene'
    <user-dbffe946c0f4@xymon.invalid <mailto:user-dbffe946c0f4@xymon.invalid>>;
    xymon at xymon.com <mailto:xymon at xymon.com>
quoted from Paul Root
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as
    that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll
    need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them
    -- as
showgraph.sh doesn't know what's current, I believe it tries to
    cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer
    term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
? ? ? ? ? ?I wasn't thinking about apache logs, I was looking in
    xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193]
    2019-09-05 15:12:22.832251 Sendto failed: Connection refused,
    referer:
    https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193]
    2019-09-05 15:12:22.832306 Sendto failed: Connection refused,
    referer:
    https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193]
    Premature end of script headers: showgraph.sh, referer:
    https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
? ? ? ? ? ?And yes, the rrd file exists in the right directory.
    It only has 1 data point at this time, but again. Running rrdtool
    graph on that file produces a graph

? ? ? ? ? ?Oh, I never mentioned before. ?This is CentOS 6 with
    my own build for 4.3.21.? I'm starting to move to the Terabithia
    repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid
    <mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene'
    <user-dbffe946c0f4@xymon.invalid <mailto:user-dbffe946c0f4@xymon.invalid>>;
    xymon at xymon.com <mailto:xymon at xymon.com>
quoted from Paul Root
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error
    logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget
    "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--
    http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80...
    connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I
    transferred the lines to graphs.cfg. But that hasn't translated
    into a graph.

rrdtool graph ConfigPulls.jpg \
? ? ? ? ? ? --title "NCM Config Pulls" \
"DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
"DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
"DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
"DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
"DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
"DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
? ? ? ? ? ? "LINE2:NetAtoD#00FF00:Net A to D" \
? ? ? ? ? ? "LINE2:NetEtoN#00CCCC:Net E to N" \
? ? ? ? ? ? "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
? ? ? ? ? ? "LINE2:Other#FF0000:Other" \
"LINE2:InfraGen#FFFF00:Infrastructure General" \
"LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
? ? ? ? ? ? "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com
    <mailto:xymon-bounces at xymon.com>> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com <mailto:xymon at xymon.com>
quoted from Paul Root
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the
    test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is
    returned as
text. But you browser expects a graph, not some text so it
    displays a
broken image symbol.

When yoy right click on one of the broken image, you can say
    'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

    This communication is the property of CenturyLink and may contain
    confidential or privileged information. Unauthorized use of this
    communication is strictly prohibited and may be unlawful. If you
    have received this communication in error, please immediately
    notify the sender by reply e-mail and destroy all copies of the
    communication and any attachments.
    

    This communication is the property of CenturyLink and may contain
    confidential or privileged information. Unauthorized use of this
    communication is strictly prohibited and may be unlawful. If you
    have received this communication in error, please immediately
    notify the sender by reply e-mail and destroy all copies of the
    communication and any attachments.


This communication is the property of CenturyLink and may contain 
confidential or privileged information. Unauthorized use of this 
communication is strictly prohibited and may be unlawful. If you have 
received this communication in error, please immediately notify the 
sender by reply e-mail and destroy all copies of the communication and 
any attachments.
list Paul Root · Mon, 9 Sep 2019 18:28:23 +0000 ·
I do see 4 archives:
filename = "ConfigPulls.rrd"
rrd_version = "0003"
step = 300
last_update = 1568044491
ds[NetAtoD].type = "GAUGE"
ds[NetAtoD].minimal_heartbeat = 600
ds[NetAtoD].min = NaN
ds[NetAtoD].max = NaN
ds[NetAtoD].last_ds = "U"
ds[NetAtoD].value = 0.0000000000e+00
ds[NetAtoD].unknown_sec = 291
ds[NetOtoZ1to9].type = "GAUGE"
ds[NetOtoZ1to9].minimal_heartbeat = 600
ds[NetOtoZ1to9].min = NaN
ds[NetOtoZ1to9].max = NaN
ds[NetOtoZ1to9].last_ds = "U"
ds[NetOtoZ1to9].value = 0.0000000000e+00
ds[NetOtoZ1to9].unknown_sec = 291
ds[Other].type = "GAUGE"
ds[Other].minimal_heartbeat = 600
ds[Other].min = NaN
ds[Other].max = NaN
ds[Other].last_ds = "U"
ds[Other].value = 0.0000000000e+00
ds[Other].unknown_sec = 291
ds[InfraGen].type = "GAUGE"
ds[InfraGen].minimal_heartbeat = 600
ds[InfraGen].min = NaN
ds[InfraGen].max = NaN
ds[InfraGen].last_ds = "U"
ds[InfraGen].value = 0.0000000000e+00
ds[InfraGen].unknown_sec = 291
ds[InfraSec].type = "GAUGE"
ds[InfraSec].minimal_heartbeat = 600
ds[InfraSec].min = NaN
ds[InfraSec].max = NaN
ds[InfraSec].last_ds = "U"
ds[InfraSec].value = 0.0000000000e+00
ds[InfraSec].unknown_sec = 291
rra[0].cf = "AVERAGE"
rra[0].rows = 576
rra[0].cur_row = 234
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[0].cdp_prep[1].value = NaN
rra[0].cdp_prep[1].unknown_datapoints = 0
rra[0].cdp_prep[2].value = NaN
rra[0].cdp_prep[2].unknown_datapoints = 0
rra[0].cdp_prep[3].value = NaN
rra[0].cdp_prep[3].unknown_datapoints = 0
rra[0].cdp_prep[4].value = NaN
rra[0].cdp_prep[4].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 576
rra[1].cur_row = 337
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = NaN
rra[1].cdp_prep[0].unknown_datapoints = 4
rra[1].cdp_prep[1].value = NaN
rra[1].cdp_prep[1].unknown_datapoints = 4
rra[1].cdp_prep[2].value = NaN
rra[1].cdp_prep[2].unknown_datapoints = 4
rra[1].cdp_prep[3].value = NaN
rra[1].cdp_prep[3].unknown_datapoints = 4
rra[1].cdp_prep[4].value = NaN
rra[1].cdp_prep[4].unknown_datapoints = 4
rra[2].cf = "AVERAGE"
rra[2].rows = 576
rra[2].cur_row = 227
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = NaN
rra[2].cdp_prep[0].unknown_datapoints = 22
rra[2].cdp_prep[1].value = NaN
rra[2].cdp_prep[1].unknown_datapoints = 22
rra[2].cdp_prep[2].value = NaN
rra[2].cdp_prep[2].unknown_datapoints = 22
rra[2].cdp_prep[3].value = NaN
rra[2].cdp_prep[3].unknown_datapoints = 22
rra[2].cdp_prep[4].value = NaN
rra[2].cdp_prep[4].unknown_datapoints = 22
rra[3].cf = "AVERAGE"
rra[3].rows = 576
rra[3].cur_row = 172
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = NaN
rra[3].cdp_prep[0].unknown_datapoints = 190
rra[3].cdp_prep[1].value = NaN
rra[3].cdp_prep[1].unknown_datapoints = 190
rra[3].cdp_prep[2].value = NaN
rra[3].cdp_prep[2].unknown_datapoints = 190
rra[3].cdp_prep[3].value = NaN
rra[3].cdp_prep[3].unknown_datapoints = 190
rra[3].cdp_prep[4].value = NaN
rra[3].cdp_prep[4].unknown_datapoints = 190


So that looks like it is populating right now.

I deleted the rrd file to start fresh. I remember in the past, that any little changes will confuse the RRD.

And I?ve set the xymon script to run every hour instead of once a day.  Unless I run a network by hand, the data will never change except the once a day.

So we?ll see in a while.
quoted from Japheth Cleaver


From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Monday, September 09, 2019 12:45 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Ralph Mitchell' <user-00a5e44c48c0@xymon.invalid>
Cc: Stef Coene <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

You should see four different RRA's (round-robin archives) when you run 'rrdtool info' on the actual RRD file, each being populated as "roll-up" averages of the various data point. For example: ]# rrdtool info clock.rrd


I suspect the issue here is the lack of data in the originating source. It seems like a once-a-day datapoint should at least be made visible in the 2d RRA, but I've not actually tried to configure one with low frequency before. Would you be able to artificially submit that point several times within a 5m period and see if it populates? Keeping --no-cache back on may be beneficial here too.

Regards,
-jc

On 9/6/2019 11:01 AM, Root, Paul T wrote:
I don?t think the rrd file is working right.

It is there, and the latest numbers are in, but I don?t see any archive numbers populating.

Where can I check for that?


From: Ralph Mitchell <user-00a5e44c48c0@xymon.invalid><mailto:user-00a5e44c48c0@xymon.invalid>
Sent: Friday, September 06, 2019 10:07 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid><mailto:user-76fdb6883669@xymon.invalid>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid><mailto:user-87556346d4af@xymon.invalid>; Stef Coene <user-dbffe946c0f4@xymon.invalid><mailto:user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

Could be wrong, but I think the graphs need two or three data points in order to show anything.

Ralph Mitchell

On Fri, Sep 6, 2019 at 9:47 AM Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
Looking in the rrd file, it doesn't seem like there are the historical data in the file.

The data is only going to change once a day, so I was only calling the script once a day.

I'm going to run the xymon script every hour to see if that gets the pump primed, and give me more data.

Does the graphing thing need more frequent data?


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com<mailto:xymon-bounces at xymon.com>> On Behalf Of Root, Paul T
Sent: Friday, September 06, 2019 8:28 AM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

No difference.

I didn't restart xymon for that, just removed the --no-cache from the lines in tasks.cfg , and killed the rrd processes.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

          And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com<mailto:xymon-bounces at xymon.com>> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Jeremy Laidman · Tue, 10 Sep 2019 23:38:06 +1000 ·
"ds[NetAtoD].minimal_heartbeat = 600"

Isn't the minimal_heartbeat setting for telling RRD to discard samples that
exist on their own? I think the idea is that it doesn't make sense to
calculate values from DERIVE or COUNTER inputs. From the man page for
rrdcreate:

<*The "heartbeat" defines the maximum acceptable interval between
samples/updates. If the interval between samples is less than "heartbeat",
then an average rate is calculated and applied for that interval. If the
interval between samples is longer than "heartbeat", then that entire
interval is considered "unknown".*>

If you're sampling once per hour, then every sample will exceed the 600
second heartbeat. So you might need to re-create (or rrdtune) your RRD file
and increase the mimimal_heartbeat value.

And from the man page for rrdtune:

<*--heartbeat|-h ds-name:heartbeat **modify the heartbeat of a data source.
By setting this to a high value the RRD will accept things like one value
per day.*>

J


On Tue, 10 Sep 2019 at 07:37, Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
I do see 4 archives:

filename = "ConfigPulls.rrd"

rrd_version = "0003"

step = 300

last_update = 1568044491

ds[NetAtoD].type = "GAUGE"

ds[NetAtoD].minimal_heartbeat = 600

ds[NetAtoD].min = NaN

ds[NetAtoD].max = NaN

ds[NetAtoD].last_ds = "U"

ds[NetAtoD].value = 0.0000000000e+00

ds[NetAtoD].unknown_sec = 291

ds[NetOtoZ1to9].type = "GAUGE"

ds[NetOtoZ1to9].minimal_heartbeat = 600

ds[NetOtoZ1to9].min = NaN

ds[NetOtoZ1to9].max = NaN

ds[NetOtoZ1to9].last_ds = "U"

ds[NetOtoZ1to9].value = 0.0000000000e+00

ds[NetOtoZ1to9].unknown_sec = 291

ds[Other].type = "GAUGE"

ds[Other].minimal_heartbeat = 600

ds[Other].min = NaN

ds[Other].max = NaN

ds[Other].last_ds = "U"

ds[Other].value = 0.0000000000e+00

ds[Other].unknown_sec = 291

ds[InfraGen].type = "GAUGE"

ds[InfraGen].minimal_heartbeat = 600

ds[InfraGen].min = NaN

ds[InfraGen].max = NaN

ds[InfraGen].last_ds = "U"

ds[InfraGen].value = 0.0000000000e+00

ds[InfraGen].unknown_sec = 291

ds[InfraSec].type = "GAUGE"

ds[InfraSec].minimal_heartbeat = 600

ds[InfraSec].min = NaN

ds[InfraSec].max = NaN

ds[InfraSec].last_ds = "U"

ds[InfraSec].value = 0.0000000000e+00

ds[InfraSec].unknown_sec = 291

rra[0].cf = "AVERAGE"

rra[0].rows = 576

rra[0].cur_row = 234

rra[0].pdp_per_row = 1

rra[0].xff = 5.0000000000e-01

rra[0].cdp_prep[0].value = NaN

rra[0].cdp_prep[0].unknown_datapoints = 0

rra[0].cdp_prep[1].value = NaN

rra[0].cdp_prep[1].unknown_datapoints = 0

rra[0].cdp_prep[2].value = NaN

rra[0].cdp_prep[2].unknown_datapoints = 0

rra[0].cdp_prep[3].value = NaN

rra[0].cdp_prep[3].unknown_datapoints = 0

rra[0].cdp_prep[4].value = NaN

rra[0].cdp_prep[4].unknown_datapoints = 0

rra[1].cf = "AVERAGE"

rra[1].rows = 576

rra[1].cur_row = 337

rra[1].pdp_per_row = 6

rra[1].xff = 5.0000000000e-01

rra[1].cdp_prep[0].value = NaN

rra[1].cdp_prep[0].unknown_datapoints = 4

rra[1].cdp_prep[1].value = NaN

rra[1].cdp_prep[1].unknown_datapoints = 4

rra[1].cdp_prep[2].value = NaN

rra[1].cdp_prep[2].unknown_datapoints = 4

rra[1].cdp_prep[3].value = NaN

rra[1].cdp_prep[3].unknown_datapoints = 4

rra[1].cdp_prep[4].value = NaN

rra[1].cdp_prep[4].unknown_datapoints = 4

rra[2].cf = "AVERAGE"

rra[2].rows = 576

rra[2].cur_row = 227

rra[2].pdp_per_row = 24

rra[2].xff = 5.0000000000e-01

rra[2].cdp_prep[0].value = NaN

rra[2].cdp_prep[0].unknown_datapoints = 22

rra[2].cdp_prep[1].value = NaN

rra[2].cdp_prep[1].unknown_datapoints = 22

rra[2].cdp_prep[2].value = NaN

rra[2].cdp_prep[2].unknown_datapoints = 22

rra[2].cdp_prep[3].value = NaN

rra[2].cdp_prep[3].unknown_datapoints = 22

rra[2].cdp_prep[4].value = NaN

rra[2].cdp_prep[4].unknown_datapoints = 22

rra[3].cf = "AVERAGE"

rra[3].rows = 576

rra[3].cur_row = 172

rra[3].pdp_per_row = 288

rra[3].xff = 5.0000000000e-01

rra[3].cdp_prep[0].value = NaN

rra[3].cdp_prep[0].unknown_datapoints = 190

rra[3].cdp_prep[1].value = NaN

rra[3].cdp_prep[1].unknown_datapoints = 190

rra[3].cdp_prep[2].value = NaN

rra[3].cdp_prep[2].unknown_datapoints = 190

rra[3].cdp_prep[3].value = NaN

rra[3].cdp_prep[3].unknown_datapoints = 190

rra[3].cdp_prep[4].value = NaN

rra[3].cdp_prep[4].unknown_datapoints = 190


So that looks like it is populating right now.


I deleted the rrd file to start fresh. I remember in the past, that any
little changes will confuse the RRD.


And I?ve set the xymon script to run every hour instead of once a day.  Unless
I run a network by hand, the data will never change except the once a day.


So we?ll see in a while.


*From:* Japheth Cleaver <user-87556346d4af@xymon.invalid>
*Sent:* Monday, September 09, 2019 12:45 PM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Ralph Mitchell' <
user-00a5e44c48c0@xymon.invalid>
*Cc:* Stef Coene <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


You should see four different RRA's (round-robin archives) when you run
'rrdtool info' on the actual RRD file, each being populated as "roll-up"
averages of the various data point. For example: ]# rrdtool info clock.rrd


I suspect the issue here is the lack of data in the originating source. It
seems like a once-a-day datapoint should at least be made visible in the 2d
RRA, but I've not actually tried to configure one with low frequency
before. Would you be able to artificially submit that point several times
within a 5m period and see if it populates? Keeping --no-cache back on may
be beneficial here too.


Regards,

-jc


On 9/6/2019 11:01 AM, Root, Paul T wrote:

I don?t think the rrd file is working right.


It is there, and the latest numbers are in, but I don?t see any archive
numbers populating.


Where can I check for that?


*From:* Ralph Mitchell <user-00a5e44c48c0@xymon.invalid> <user-00a5e44c48c0@xymon.invalid>
*Sent:* Friday, September 06, 2019 10:07 AM

*To:* Root, Paul T <user-76fdb6883669@xymon.invalid> <user-76fdb6883669@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid> <user-87556346d4af@xymon.invalid>;
Stef Coene <user-dbffe946c0f4@xymon.invalid> <user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
quoted from Paul Root
*Subject:* Re: [Xymon] Graphing in Xymon


Could be wrong, but I think the graphs need two or three data points in
order to show anything.


Ralph Mitchell


On Fri, Sep 6, 2019 at 9:47 AM Root, Paul T <user-76fdb6883669@xymon.invalid>
wrote:

Looking in the rrd file, it doesn't seem like there are the historical
data in the file.

The data is only going to change once a day, so I was only calling the
script once a day.

I'm going to run the xymon script every hour to see if that gets the pump
primed, and give me more data.

Does the graphing thing need more frequent data?


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Root, Paul T
Sent: Friday, September 06, 2019 8:28 AM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

No difference.

I didn't restart xymon for that, just removed the --no-cache from the
lines in tasks.cfg , and killed the rrd processes.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd
--rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd
--rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with
variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon
logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05
15:12:22.832251 Sendto failed: Connection refused, referer:
https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05
15:12:22.832306 Sendto failed: Connection refused, referer:
https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end
of script headers: showgraph.sh, referer:
https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
          And yes, the rrd file exists in the right directory. It only
has 1 data point at this time, but again. Running rrdtool graph on that
file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own
build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't
got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>; 'Stef Coene' <
user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "
http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
"
--2019-09-05 14:46:58--
http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred
the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open
image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.

list Paul Root · Tue, 10 Sep 2019 14:09:14 +0000 ·
Excellent, that?s probably the key.

I?ve made the change, I?m guessing I need a new input before anything can work.

rrdtool tune ConfigPulls.rrd -h NetAtoD:86400 -h NetEtoN:86400 -h NetOtoZ1to9:86400 -h Other:86400 -h InfraGen:86400 -h InfraSec:86400

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE rrd SYSTEM "http://oss.oetiker.ch/rrdtool/rrdtool.dtd">;
<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>
        <step> 300 </step> <!-- Seconds -->
        <lastupdate> 1568123701 </lastupdate> <!-- 2019-09-10 08:55:01 CDT -->

        <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 86400 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 167 </last_ds>
                <value> NaN </value>
                <unknown_sec> 1 </unknown_sec>
       </ds>


Impatient as I am, I manually ran the script again, and then ran the rrdtool graph, and I got data points on the graph. So I should be close now.

Thanks,
Paul.
quoted from Jeremy Laidman

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
Sent: Tuesday, September 10, 2019 8:38 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

"ds[NetAtoD].minimal_heartbeat = 600"

Isn't the minimal_heartbeat setting for telling RRD to discard samples that exist on their own? I think the idea is that it doesn't make sense to calculate values from DERIVE or COUNTER inputs. From the man page for rrdcreate:

<The "heartbeat" defines the maximum acceptable interval between samples/updates. If the interval between samples is less than "heartbeat", then an average rate is calculated and applied for that interval. If the interval between samples is longer than "heartbeat", then that entire interval is considered "unknown".>

If you're sampling once per hour, then every sample will exceed the 600 second heartbeat. So you might need to re-create (or rrdtune) your RRD file and increase the mimimal_heartbeat value.

And from the man page for rrdtune:

<--heartbeat|-h ds-name:heartbeat
modify the heartbeat of a data source. By setting this to a high value the RRD will accept things like one value per day.>

J


On Tue, 10 Sep 2019 at 07:37, Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
I do see 4 archives:
filename = "ConfigPulls.rrd"
rrd_version = "0003"
step = 300
last_update = 1568044491
ds[NetAtoD].type = "GAUGE"
ds[NetAtoD].minimal_heartbeat = 600
ds[NetAtoD].min = NaN
ds[NetAtoD].max = NaN
ds[NetAtoD].last_ds = "U"
ds[NetAtoD].value = 0.0000000000e+00
ds[NetAtoD].unknown_sec = 291
ds[NetOtoZ1to9].type = "GAUGE"
ds[NetOtoZ1to9].minimal_heartbeat = 600
ds[NetOtoZ1to9].min = NaN
ds[NetOtoZ1to9].max = NaN
ds[NetOtoZ1to9].last_ds = "U"
ds[NetOtoZ1to9].value = 0.0000000000e+00
ds[NetOtoZ1to9].unknown_sec = 291
ds[Other].type = "GAUGE"
ds[Other].minimal_heartbeat = 600
ds[Other].min = NaN
ds[Other].max = NaN
ds[Other].last_ds = "U"
ds[Other].value = 0.0000000000e+00
ds[Other].unknown_sec = 291
ds[InfraGen].type = "GAUGE"
ds[InfraGen].minimal_heartbeat = 600
ds[InfraGen].min = NaN
ds[InfraGen].max = NaN
ds[InfraGen].last_ds = "U"
ds[InfraGen].value = 0.0000000000e+00
ds[InfraGen].unknown_sec = 291
ds[InfraSec].type = "GAUGE"
ds[InfraSec].minimal_heartbeat = 600
ds[InfraSec].min = NaN
ds[InfraSec].max = NaN
ds[InfraSec].last_ds = "U"
ds[InfraSec].value = 0.0000000000e+00
ds[InfraSec].unknown_sec = 291
rra[0].cf = "AVERAGE"
rra[0].rows = 576
rra[0].cur_row = 234
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[0].cdp_prep[1].value = NaN
rra[0].cdp_prep[1].unknown_datapoints = 0
rra[0].cdp_prep[2].value = NaN
rra[0].cdp_prep[2].unknown_datapoints = 0
rra[0].cdp_prep[3].value = NaN
rra[0].cdp_prep[3].unknown_datapoints = 0
rra[0].cdp_prep[4].value = NaN
rra[0].cdp_prep[4].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 576
rra[1].cur_row = 337
rra[1].pdp_per_row = 6
rra[1].xff = 5.0000000000e-01
rra[1].cdp_prep[0].value = NaN
rra[1].cdp_prep[0].unknown_datapoints = 4
rra[1].cdp_prep[1].value = NaN
rra[1].cdp_prep[1].unknown_datapoints = 4
rra[1].cdp_prep[2].value = NaN
rra[1].cdp_prep[2].unknown_datapoints = 4
rra[1].cdp_prep[3].value = NaN
rra[1].cdp_prep[3].unknown_datapoints = 4
rra[1].cdp_prep[4].value = NaN
rra[1].cdp_prep[4].unknown_datapoints = 4
rra[2].cf = "AVERAGE"
rra[2].rows = 576
rra[2].cur_row = 227
rra[2].pdp_per_row = 24
rra[2].xff = 5.0000000000e-01
rra[2].cdp_prep[0].value = NaN
rra[2].cdp_prep[0].unknown_datapoints = 22
rra[2].cdp_prep[1].value = NaN
rra[2].cdp_prep[1].unknown_datapoints = 22
rra[2].cdp_prep[2].value = NaN
rra[2].cdp_prep[2].unknown_datapoints = 22
rra[2].cdp_prep[3].value = NaN
rra[2].cdp_prep[3].unknown_datapoints = 22
rra[2].cdp_prep[4].value = NaN
rra[2].cdp_prep[4].unknown_datapoints = 22
rra[3].cf = "AVERAGE"
rra[3].rows = 576
rra[3].cur_row = 172
rra[3].pdp_per_row = 288
rra[3].xff = 5.0000000000e-01
rra[3].cdp_prep[0].value = NaN
rra[3].cdp_prep[0].unknown_datapoints = 190
rra[3].cdp_prep[1].value = NaN
rra[3].cdp_prep[1].unknown_datapoints = 190
rra[3].cdp_prep[2].value = NaN
rra[3].cdp_prep[2].unknown_datapoints = 190
rra[3].cdp_prep[3].value = NaN
rra[3].cdp_prep[3].unknown_datapoints = 190
rra[3].cdp_prep[4].value = NaN
rra[3].cdp_prep[4].unknown_datapoints = 190


So that looks like it is populating right now.

I deleted the rrd file to start fresh. I remember in the past, that any little changes will confuse the RRD.

And I?ve set the xymon script to run every hour instead of once a day.  Unless I run a network by hand, the data will never change except the once a day.

So we?ll see in a while.


From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Monday, September 09, 2019 12:45 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Ralph Mitchell' <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>
Cc: Stef Coene <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

You should see four different RRA's (round-robin archives) when you run 'rrdtool info' on the actual RRD file, each being populated as "roll-up" averages of the various data point. For example: ]# rrdtool info clock.rrd

I suspect the issue here is the lack of data in the originating source. It seems like a once-a-day datapoint should at least be made visible in the 2d RRA, but I've not actually tried to configure one with low frequency before. Would you be able to artificially submit that point several times within a 5m period and see if it populates? Keeping --no-cache back on may be beneficial here too.

Regards,
-jc

On 9/6/2019 11:01 AM, Root, Paul T wrote:
I don?t think the rrd file is working right.

It is there, and the latest numbers are in, but I don?t see any archive numbers populating.

Where can I check for that?


From: Ralph Mitchell <user-00a5e44c48c0@xymon.invalid><mailto:user-00a5e44c48c0@xymon.invalid>
Sent: Friday, September 06, 2019 10:07 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid><mailto:user-76fdb6883669@xymon.invalid>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid><mailto:user-87556346d4af@xymon.invalid>; Stef Coene <user-dbffe946c0f4@xymon.invalid><mailto:user-dbffe946c0f4@xymon.invalid>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

Could be wrong, but I think the graphs need two or three data points in order to show anything.

Ralph Mitchell

On Fri, Sep 6, 2019 at 9:47 AM Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
Looking in the rrd file, it doesn't seem like there are the historical data in the file.

The data is only going to change once a day, so I was only calling the script once a day.

I'm going to run the xymon script every hour to see if that gets the pump primed, and give me more data.

Does the graphing thing need more frequent data?


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com<mailto:xymon-bounces at xymon.com>> On Behalf Of Root, Paul T
Sent: Friday, September 06, 2019 8:28 AM
To: 'Japheth Cleaver' <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

No difference.

I didn't restart xymon for that, just removed the --no-cache from the lines in tasks.cfg , and killed the rrd processes.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 5:19 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

Hmm.

That's definitely odd, but if at least some of the graphs are showing
then it's not an overall systemic issue. Have you tried removing the
--no-cache from the RRD calls by any chance?

-jc

On 9/5/2019 1:48 PM, Root, Paul T wrote:
Those files look ok

$ fuser *
rrdctl.2339:          2339
rrdctl.2437:          2437
$ ps -ef |grep 2339
xymon     2339  2323  0 15:09 ?        00:00:09 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5083  4674  0 15:43 pts/0    00:00:00 grep 2339
$ ps -ef |grep 2437
xymon     2437  2324  0 15:09 ?        00:00:00 xymond_rrd --rrddir=/var/lib/xymon/rrd --no-cache
root      5086  4674  0 15:43 pts/0    00:00:00 grep 2437
$ ls -la
total 19964
drwxr-xr-x.  2 xymon xymon     4096 Sep  5 15:39 .
drwxr-xr-x. 12 xymon xymon     4096 Mar  1  2016 ..
-rw-rw-r--.  1 xymon xymon    52136 Sep  5 15:43 alert.chk
-rw-rw-r--.  1 xymon xymon       96 Sep  5 15:43 alert.chk.sub
-rw-r--r--.  1 xymon xymon       24 Sep  5 15:39 ping..status
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2339
srw-rw-rw-.  1 xymon xymon        0 Sep  5 15:09 rrdctl.2437
-rw-r--r--.  1 xymon xymon       22 Oct 19  2018 ssh_8022..status
-rw-r--r--.  1 xymon xymon 20366660 Sep  5 15:39 xymond.chk

Selinux is set to permissive.

Most graphs are working for other tests. Some complicated ones with variable data points. I didn't set those up, but they are working well.

-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 3:33 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

This is probably a sign of invalid rrdctl socket files, as that's what
showgraph is trying to use to communicate with xymond_rrd.

These should be in the TMP/RUN dir on a source compile, named
"rrdctl.<pid>", one for each of the currently running xymond_rrd
processes (usually two,m one for status, one for data). They'll need to
be writable by your apache user at least, and SELinux may require
additional permissions for the sendto if you have it enabled and
enforcing. If you see lots of stale ones, be sure to remove them -- as
showgraph.sh doesn't know what's current, I believe it tries to cycle
through all of them, which could end up in timeouts.

Regardless, premature header ending isn't a desired result no matter
what the situation. Trying to find all cases of this is a longer term
goal for all the CGIs.

HTH,
-jc

On 9/5/2019 1:16 PM, Root, Paul T wrote:
Ah,
          I wasn't thinking about apache logs, I was looking in xymon logs. Yes, errors:


[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832251 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:22 2019] [error] [client 10.139.63.193] 2019-09-05 15:12:22.832306 Sendto failed: Connection refused, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls
[Thu Sep 05 15:12:23 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://nsmdenvp117.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

          And yes, the rrd file exists in the right directory. It only has 1 data point at this time, but again. Running rrdtool graph on that file produces a graph


          Oh, I never mentioned before.   This is CentOS 6 with my own build for 4.3.21.  I'm starting to move to the Terabithia repo, but haven't got there yet on the server.

Paul.


-----Original Message-----
From: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>
Sent: Thursday, September 05, 2019 3:00 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>; 'Stef Coene' <user-dbffe946c0f4@xymon.invalid<mailto:user-dbffe946c0f4@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

A 500 ISE isn't a good sign. Is there anything in the web error logs?

And just to confirm, the file does actually existing in the RRD
directory as expected?

Regards,
-jc

On 9/5/2019 12:56 PM, Root, Paul T wrote:
Not much help here:

$ wget "http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view";
--2019-09-05 14:46:58--  http://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh?host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=green&graph_start=1567539940&graph_end=1567712740&graph=hourly&action=view
Resolving nsmdenvp117.corp.intranet... 151.119.9.117
Connecting to nsmdenvp117.corp.intranet|151.119.9.117|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
2019-09-05 14:46:59 ERROR 500: Internal Server Error.


Running the rrdtool graph by hand, does work now, and I transferred the lines to graphs.cfg.  But that hasn't translated into a graph.

rrdtool graph ConfigPulls.jpg \
           --title "NCM Config Pulls" \
           "DEF:NetAtoD=ConfigPulls.rrd:NetAtoD:AVERAGE" \
           "DEF:NetEtoN=ConfigPulls.rrd:NetEtoN:AVERAGE" \
           "DEF:NetOtoZ1to9=ConfigPulls.rrd:NetOtoZ1to9:AVERAGE" \
           "DEF:Other=ConfigPulls.rrd:Other:AVERAGE" \
           "DEF:InfraGen=ConfigPulls.rrd:InfraGen:AVERAGE" \
           "DEF:InfraSec=ConfigPulls.rrd:InfraSec:AVERAGE" \
           "LINE2:NetAtoD#00FF00:Net A to D" \
           "LINE2:NetEtoN#00CCCC:Net E to N" \
           "LINE2:NetOtoZ1to9#FFCC00:Net O to Z & 1 to 9" \
           "LINE2:Other#FF0000:Other" \
           "LINE2:InfraGen#FFFF00:Infrastructure General" \
           "LINE2:InfraSec#FFFFCC:Infrastructure Secure" \
           "COMMENT:\n"


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com<mailto:xymon-bounces at xymon.com>> On Behalf Of Stef Coene
Sent: Thursday, September 05, 2019 2:18 PM
To: xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

On 4/09/19 19:59, Root, Paul T wrote:
The graph doesn't show up, just a broken link in both the test and
trends pages.

Any help?
Then there is a problem generating the RRD, the error is returned as
text. But you browser expects a graph, not some text so it displays a
broken image symbol.

When yoy right click on one of the broken image, you can say 'open image
in new tab'.
This will give you the direct URL of the graph.
If you do a wget of this URL (don't forget quotes!) on your xymon
server, you will download the real error.
Just do a vi of the downloaded file to see this error.


Stef

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Paul Root · Tue, 10 Sep 2019 16:07:14 +0000 ·
A couple hours later, and still no graph in xymon.  Ssl_error_log yields:

[Tue Sep 10 11:01:36 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://xymon.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

The manual graph is still getting more data in, using the exact same definitions as in graphs.cfg.
quoted from Paul Root

From: Root, Paul T
Sent: Tuesday, September 10, 2019 9:09 AM
To: 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
Subject: RE: [Xymon] Graphing in Xymon

Excellent, that?s probably the key.

I?ve made the change, I?m guessing I need a new input before anything can work.

rrdtool tune ConfigPulls.rrd -h NetAtoD:86400 -h NetEtoN:86400 -h NetOtoZ1to9:86400 -h Other:86400 -h InfraGen:86400 -h InfraSec:86400

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE rrd SYSTEM "http://oss.oetiker.ch/rrdtool/rrdtool.dtd">;
<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>
        <step> 300 </step> <!-- Seconds -->
        <lastupdate> 1568123701 </lastupdate> <!-- 2019-09-10 08:55:01 CDT -->

        <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 86400 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 167 </last_ds>
                <value> NaN </value>
                <unknown_sec> 1 </unknown_sec>
       </ds>


Impatient as I am, I manually ran the script again, and then ran the rrdtool graph, and I got data points on the graph. So I should be close now.

Thanks,
Paul.

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Sent: Tuesday, September 10, 2019 8:38 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

"ds[NetAtoD].minimal_heartbeat = 600"

Isn't the minimal_heartbeat setting for telling RRD to discard samples that exist on their own? I think the idea is that it doesn't make sense to calculate values from DERIVE or COUNTER inputs. From the man page for rrdcreate:

<The "heartbeat" defines the maximum acceptable interval between samples/updates. If the interval between samples is less than "heartbeat", then an average rate is calculated and applied for that interval. If the interval between samples is longer than "heartbeat", then that entire interval is considered "unknown".>

If you're sampling once per hour, then every sample will exceed the 600 second heartbeat. So you might need to re-create (or rrdtune) your RRD file and increase the mimimal_heartbeat value.

And from the man page for rrdtune:

<--heartbeat|-h ds-name:heartbeat
modify the heartbeat of a data source. By setting this to a high value the RRD will accept things like one value per day.>

J


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Jeremy Laidman · Wed, 11 Sep 2019 02:46:04 +1000 ·
I thing RRD needs two or more consecutive data points before it produces
results. If you add more than one within a timeslot, it rejects the second
and subsequent ones. If you've configured your RRD file to work on an
hourly basis, you need to wait 2-3 hours.

On Wed, 11 Sep 2019 at 02:07, Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
A couple hours later, and still no graph in xymon.  Ssl_error_log yields:


[Tue Sep 10 11:01:36 2019] [error] [client 10.139.63.193] Premature end of
script headers: showgraph.sh, referer:
https://xymon.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls


The manual graph is still getting more data in, using the exact same
definitions as in graphs.cfg.


*From:* Root, Paul T
*Sent:* Tuesday, September 10, 2019 9:09 AM
*To:* 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <
user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
*Subject:* RE: [Xymon] Graphing in Xymon


Excellent, that?s probably the key.


I?ve made the change, I?m guessing I need a new input before anything can
work.


rrdtool tune ConfigPulls.rrd -h NetAtoD:86400 -h NetEtoN:86400 -h
NetOtoZ1to9:86400 -h Other:86400 -h InfraGen:86400 -h InfraSec:86400


<?xml version="1.0" encoding="utf-8"?>

<!DOCTYPE rrd SYSTEM "http://oss.oetiker.ch/rrdtool/rrdtool.dtd">;

<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>

        <step> 300 </step> <!-- Seconds -->

        <lastupdate> 1568123701 </lastupdate> <!-- 2019-09-10 08:55:01
CDT -->


        <ds>

                <name> NetAtoD </name>

                <type> GAUGE </type>

                <minimal_heartbeat> 86400 </minimal_heartbeat>

                <min> NaN </min>

                <max> NaN </max>


                <!-- PDP Status -->

                <last_ds> 167 </last_ds>

                <value> NaN </value>

                <unknown_sec> 1 </unknown_sec>

       </ds>


Impatient as I am, I manually ran the script again, and then ran the
rrdtool graph, and I got data points on the graph. So I should be close
now.


Thanks,

Paul.


*From:* Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
*Sent:* Tuesday, September 10, 2019 8:38 AM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <
user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


"ds[NetAtoD].minimal_heartbeat = 600"


Isn't the minimal_heartbeat setting for telling RRD to discard samples
that exist on their own? I think the idea is that it doesn't make sense to
calculate values from DERIVE or COUNTER inputs. From the man page for
rrdcreate:


<*The "heartbeat" defines the maximum acceptable interval between
samples/updates. If the interval between samples is less than "heartbeat",
then an average rate is calculated and applied for that interval. If the
interval between samples is longer than "heartbeat", then that entire
interval is considered "unknown".*>


If you're sampling once per hour, then every sample will exceed the 600
second heartbeat. So you might need to re-create (or rrdtune) your RRD file
and increase the mimimal_heartbeat value.


And from the man page for rrdtune:


<*--heartbeat**|-h ds-name:heartbeat *

*modify the heartbeat of a data source. By setting this to a high value
the **RRD will accept things like one value per day.*>


J


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.
list Paul Root · Wed, 11 Sep 2019 13:25:38 +0000 ·
Looking this morning. There is no change, no graph.

Manually making the graph works perfectly.
quoted from Jeremy Laidman

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
Sent: Tuesday, September 10, 2019 11:46 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

I thing RRD needs two or more consecutive data points before it produces results. If you add more than one within a timeslot, it rejects the second and subsequent ones. If you've configured your RRD file to work on an hourly basis, you need to wait 2-3 hours.

On Wed, 11 Sep 2019 at 02:07, Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
A couple hours later, and still no graph in xymon.  Ssl_error_log yields:

[Tue Sep 10 11:01:36 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://xymon.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

The manual graph is still getting more data in, using the exact same definitions as in graphs.cfg.

From: Root, Paul T
Sent: Tuesday, September 10, 2019 9:09 AM
To: 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: RE: [Xymon] Graphing in Xymon

Excellent, that?s probably the key.

I?ve made the change, I?m guessing I need a new input before anything can work.

rrdtool tune ConfigPulls.rrd -h NetAtoD:86400 -h NetEtoN:86400 -h NetOtoZ1to9:86400 -h Other:86400 -h InfraGen:86400 -h InfraSec:86400

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE rrd SYSTEM "http://oss.oetiker.ch/rrdtool/rrdtool.dtd">;
<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>
        <step> 300 </step> <!-- Seconds -->
        <lastupdate> 1568123701 </lastupdate> <!-- 2019-09-10 08:55:01 CDT -->

        <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 86400 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 167 </last_ds>
                <value> NaN </value>
                <unknown_sec> 1 </unknown_sec>
       </ds>


Impatient as I am, I manually ran the script again, and then ran the rrdtool graph, and I got data points on the graph. So I should be close now.

Thanks,
Paul.

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Sent: Tuesday, September 10, 2019 8:38 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

"ds[NetAtoD].minimal_heartbeat = 600"

Isn't the minimal_heartbeat setting for telling RRD to discard samples that exist on their own? I think the idea is that it doesn't make sense to calculate values from DERIVE or COUNTER inputs. From the man page for rrdcreate:

<The "heartbeat" defines the maximum acceptable interval between samples/updates. If the interval between samples is less than "heartbeat", then an average rate is calculated and applied for that interval. If the interval between samples is longer than "heartbeat", then that entire interval is considered "unknown".>

If you're sampling once per hour, then every sample will exceed the 600 second heartbeat. So you might need to re-create (or rrdtune) your RRD file and increase the mimimal_heartbeat value.

And from the man page for rrdtune:

<--heartbeat|-h ds-name:heartbeat
modify the heartbeat of a data source. By setting this to a high value the RRD will accept things like one value per day.>

J


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Paul Root · Mon, 16 Sep 2019 19:53:09 +0000 ·
Looping back on this:

Running the showgraph by hand

$ ./showgraph.sh host=nsmdenvp185 service=ncv:ConfigPulls graph_width=576 graph_height=120 disp=nsmdenvp185 nostale color=blue graph_start=1568489816 graph_end=1568662616 graph=hourly action=view

Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>

$ ls /var/lib/xymon/rrd/nsmdenvp185/ConfigPulls*
/var/lib/xymon/rrd/nsmdenvp185/ConfigPulls.rrd
root nsmdenvp117:/usr/lib64/xymon/cgi-bin
$ cat ~ptroot/crap2
#!/bin/bash

$ curl -k https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh\?host=nsmdenvp185\&service=ncv:ConfigPulls\&graph_width=576\&graph_height=120\&disp=nsmdenvp185\&nostale\&color=blue\&graph_start=1568489816\&graph_end=1568662616\&graph=hourly\&action=view
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>500 Internal Server Error</title>
</head><body>
<h1>Internal Server Error</h1>
<p>The server encountered an internal error or
misconfiguration and was unable to complete
your request.</p>
<p>Please contact the server administrator,
user-232e42044632@xymon.invalid and inform them of the time the error occurred,
and anything you might have done that may have
caused the error.</p>
<p>More information about this error may be available
in the server error log.</p>
<hr>
<address>Apache/2.2.15 (CentOS) user-7c51896be91f@xymon.invalid Port 443</address>
</body></html>


Again, if I run rrdtool graph by hand, I get a good graph..


Could this be the Test name is too long for showgraph, or maybe doesn?t like mixed case?
quoted from Paul Root


From: Xymon <xymon-bounces at xymon.com> On Behalf Of Root, Paul T
Sent: Wednesday, September 11, 2019 8:26 AM
To: 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid>
Cc: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Looking this morning. There is no change, no graph.

Manually making the graph works perfectly.

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Sent: Tuesday, September 10, 2019 11:46 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

I thing RRD needs two or more consecutive data points before it produces results. If you add more than one within a timeslot, it rejects the second and subsequent ones. If you've configured your RRD file to work on an hourly basis, you need to wait 2-3 hours.

On Wed, 11 Sep 2019 at 02:07, Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
A couple hours later, and still no graph in xymon.  Ssl_error_log yields:

[Tue Sep 10 11:01:36 2019] [error] [client 10.139.63.193] Premature end of script headers: showgraph.sh, referer: https://xymon.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls

The manual graph is still getting more data in, using the exact same definitions as in graphs.cfg.

From: Root, Paul T
Sent: Tuesday, September 10, 2019 9:09 AM
To: 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: RE: [Xymon] Graphing in Xymon

Excellent, that?s probably the key.

I?ve made the change, I?m guessing I need a new input before anything can work.

rrdtool tune ConfigPulls.rrd -h NetAtoD:86400 -h NetEtoN:86400 -h NetOtoZ1to9:86400 -h Other:86400 -h InfraGen:86400 -h InfraSec:86400

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE rrd SYSTEM "http://oss.oetiker.ch/rrdtool/rrdtool.dtd">;
<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>
        <step> 300 </step> <!-- Seconds -->
        <lastupdate> 1568123701 </lastupdate> <!-- 2019-09-10 08:55:01 CDT -->

        <ds>
                <name> NetAtoD </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 86400 </minimal_heartbeat>
                <min> NaN </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> 167 </last_ds>
                <value> NaN </value>
                <unknown_sec> 1 </unknown_sec>
       </ds>


Impatient as I am, I manually ran the script again, and then ran the rrdtool graph, and I got data points on the graph. So I should be close now.

Thanks,
Paul.

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Sent: Tuesday, September 10, 2019 8:38 AM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>
Cc: Japheth Cleaver <user-87556346d4af@xymon.invalid<mailto:user-87556346d4af@xymon.invalid>>; Ralph Mitchell <user-00a5e44c48c0@xymon.invalid<mailto:user-00a5e44c48c0@xymon.invalid>>; xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

"ds[NetAtoD].minimal_heartbeat = 600"

Isn't the minimal_heartbeat setting for telling RRD to discard samples that exist on their own? I think the idea is that it doesn't make sense to calculate values from DERIVE or COUNTER inputs. From the man page for rrdcreate:

<The "heartbeat" defines the maximum acceptable interval between samples/updates. If the interval between samples is less than "heartbeat", then an average rate is calculated and applied for that interval. If the interval between samples is longer than "heartbeat", then that entire interval is considered "unknown".>

If you're sampling once per hour, then every sample will exceed the 600 second heartbeat. So you might need to re-create (or rrdtune) your RRD file and increase the mimimal_heartbeat value.

And from the man page for rrdtune:

<--heartbeat|-h ds-name:heartbeat
modify the heartbeat of a data source. By setting this to a high value the RRD will accept things like one value per day.>

J


This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Jeremy Laidman · Tue, 17 Sep 2019 06:38:27 +1000 ·
On Tue, 17 Sep 2019 at 05:53, Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
Looping back on this:


Running the showgraph by hand


$ *./showgraph.sh host=nsmdenvp185 service=ncv:ConfigPulls
graph_width=576 graph_height=120 disp=nsmdenvp185 nostale color=blue
graph_start=1568489816 graph_end=1568662616 graph=hourly action=view*
This won't work. The showgraph.cgi binary expects to be run as a CGI and
requires QUERY_STRING to be set (to
host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=...) and
REQUEST_MATHOD to be set to "GET". It also expects SCRIPT_NAME to be set
(and normally it would be showgraph.sh) but I think this only generates
warnings.

Try running like so:

SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
./showgraph.sh

The output will be partly binary, so you might want to try:

SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
./showgraph.sh | sed '1,/^$/d' | file -

and see if it shows that a PNG file format was generated.

If this doesn't work, check for a service name such as "cpu" that is known
to work, rather than your custom "ncv:ConfigPulls".

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>
Yep, cos no QUERY_STRING.

$ *ls /var/lib/xymon/rrd/nsmdenvp185/ConfigPulls**

/var/lib/xymon/rrd/nsmdenvp185/ConfigPulls.rrd

root nsmdenvp117:/usr/lib64/xymon/cgi-bin

$ cat ~ptroot/crap2

#!/bin/bash


$* curl -k
https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh\?host=nsmdenvp185\&service=ncv:ConfigPulls\&graph_width=576\&graph_height=120\&disp=nsmdenvp185\&nostale\&color=blue\&graph_start=1568489816\&graph_end=1568662616\&graph=hourly\&action=view
<https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh%5C?host=nsmdenvp185%5C&service=ncv:ConfigPulls%5C&graph_width=576%5C&graph_height=120%5C&disp=nsmdenvp185%5C&nostale%5C&color=blue%5C&graph_start=1568489816%5C&graph_end=1568662616%5C&graph=hourly%5C&action=view>*

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<html><head>

<title>500 Internal Server Error</title>
This works for me (substituting my own Xymon servername, hostname and
service.

</head><body>
<h1>Internal Server Error</h1>
Check your Apache/webserver logs for the cause.
quoted from Paul Root

Again, if I run rrdtool graph by hand, I get a good graph..


Could this be the Test name is too long for showgraph, or maybe doesn?t
like mixed case?
I don't think so. I have a graph that shows with
"service=bind9-stats-extended" which is longer than your "nsv:ConfigPulls"
including the prefix.

J
quoted from Paul Root

*From:* Xymon <xymon-bounces at xymon.com> *On Behalf Of *Root, Paul T
*Sent:* Wednesday, September 11, 2019 8:26 AM
*To:* 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid>
*Cc:* xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


Looking this morning. There is no change, no graph.


Manually making the graph works perfectly.


*From:* Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
*Sent:* Tuesday, September 10, 2019 11:46 AM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <
user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


I thing RRD needs two or more consecutive data points before it produces
results. If you add more than one within a timeslot, it rejects the second
and subsequent ones. If you've configured your RRD file to work on an
hourly basis, you need to wait 2-3 hours.


On Wed, 11 Sep 2019 at 02:07, Root, Paul T <user-76fdb6883669@xymon.invalid>
wrote:

A couple hours later, and still no graph in xymon.  Ssl_error_log yields:


[Tue Sep 10 11:01:36 2019] [error] [client 10.139.63.193] Premature end of
script headers: showgraph.sh, referer:
https://xymon.corp.intranet/xymon-cgi/svcstatus.sh?HOST=nsmdenvp185&SERVICE=ConfigPulls


The manual graph is still getting more data in, using the exact same
definitions as in graphs.cfg.


*From:* Root, Paul T
*Sent:* Tuesday, September 10, 2019 9:09 AM
*To:* 'Jeremy Laidman' <user-0608abae5e7c@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <
user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
*Subject:* RE: [Xymon] Graphing in Xymon


Excellent, that?s probably the key.


I?ve made the change, I?m guessing I need a new input before anything can
work.


rrdtool tune ConfigPulls.rrd -h NetAtoD:86400 -h NetEtoN:86400 -h
NetOtoZ1to9:86400 -h Other:86400 -h InfraGen:86400 -h InfraSec:86400


<?xml version="1.0" encoding="utf-8"?>

<!DOCTYPE rrd SYSTEM "http://oss.oetiker.ch/rrdtool/rrdtool.dtd">;

<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>

        <step> 300 </step> <!-- Seconds -->

        <lastupdate> 1568123701 </lastupdate> <!-- 2019-09-10 08:55:01 CDT
-->


        <ds>

                <name> NetAtoD </name>

                <type> GAUGE </type>

                <minimal_heartbeat> 86400 </minimal_heartbeat>

                <min> NaN </min>

                <max> NaN </max>


                <!-- PDP Status -->

                <last_ds> 167 </last_ds>

                <value> NaN </value>

                <unknown_sec> 1 </unknown_sec>

       </ds>


Impatient as I am, I manually ran the script again, and then ran the
rrdtool graph, and I got data points on the graph. So I should be close
now.


Thanks,

Paul.


*From:* Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
*Sent:* Tuesday, September 10, 2019 8:38 AM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* Japheth Cleaver <user-87556346d4af@xymon.invalid>; Ralph Mitchell <
user-00a5e44c48c0@xymon.invalid>; xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


"ds[NetAtoD].minimal_heartbeat = 600"


Isn't the minimal_heartbeat setting for telling RRD to discard samples
that exist on their own? I think the idea is that it doesn't make sense to
calculate values from DERIVE or COUNTER inputs. From the man page for
rrdcreate:


<*The "heartbeat" defines the maximum acceptable interval between
samples/updates. If the interval between samples is less than "heartbeat",
then an average rate is calculated and applied for that interval. If the
interval between samples is longer than "heartbeat", then that entire
interval is considered "unknown".*>


If you're sampling once per hour, then every sample will exceed the 600
second heartbeat. So you might need to re-create (or rrdtune) your RRD file
and increase the mimimal_heartbeat value.


And from the man page for rrdtune:


<*--heartbeat**|-h ds-name:heartbeat *

*modify the heartbeat of a data source. By setting this to a high value
the **RRD will accept things like one value per day.*>


J


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.

This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.
This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.
list Paul Root · Tue, 17 Sep 2019 18:32:25 +0000 ·
I must be doing something group here, neither worked:

$ SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
root nsmdenvp117:/etc/xymon/analysis.d
$ QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
$ PATH=$PATH:/usr/lib64/xymon/cgi-bin
$ type showgraph.sh
showgraph.sh is /usr/lib64/xymon/cgi-bin/showgraph.sh
$ showgraph.sh
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>
$ export QUERY_STRING
$ export SCRIPTNAME
$ $SCRIPTNAME
$ export SCRIPT_NAME
$ $SCRIPT_NAME
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>
$ QUERY_STRING='host=nsmdenvp185&service=cpu&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
$ $SCRIPT_NAME
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>
$ file /usr/lib64/xymon/cgi-bin/showgraph.sh
/usr/lib64/xymon/cgi-bin/showgraph.sh: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux 2.6.18, stripped
quoted from Jeremy Laidman

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
Sent: Monday, September 16, 2019 3:38 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

On Tue, 17 Sep 2019 at 05:53, Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
Looping back on this:

Running the showgraph by hand

$ ./showgraph.sh host=nsmdenvp185 service=ncv:ConfigPulls graph_width=576 graph_height=120 disp=nsmdenvp185 nostale color=blue graph_start=1568489816 graph_end=1568662616 graph=hourly action=view

This won't work. The showgraph.cgi binary expects to be run as a CGI and requires QUERY_STRING to be set (to host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=...) and REQUEST_MATHOD to be set to "GET". It also expects SCRIPT_NAME to be set (and normally it would be showgraph.sh) but I think this only generates warnings.

Try running like so:

SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view' ./showgraph.sh

The output will be partly binary, so you might want to try:

SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view' ./showgraph.sh | sed '1,/^$/d' | file -

and see if it shows that a PNG file format was generated.

If this doesn't work, check for a service name such as "cpu" that is known to work, rather than your custom "ncv:ConfigPulls".


Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>

Yep, cos no QUERY_STRING.


$ ls /var/lib/xymon/rrd/nsmdenvp185/ConfigPulls*
/var/lib/xymon/rrd/nsmdenvp185/ConfigPulls.rrd
root nsmdenvp117:/usr/lib64/xymon/cgi-bin
$ cat ~ptroot/crap2
#!/bin/bash

$ curl -k https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh\?host=nsmdenvp185\&service=ncv:ConfigPulls\&graph_width=576\&graph_height=120\&disp=nsmdenvp185\&nostale\&color=blue\&graph_start=1568489816\&graph_end=1568662616\&graph=hourly\&action=view<https://imss91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2fnsmdenvp117.corp.intranet%2fxymon%2dcgi%2fshowgraph.sh%255C%3fhost%3dnsmdenvp185%255C%26service%3dncv%3aConfigPulls%255C%26graph%5fwidth%3d576%255C%26graph%5fheight%3d120%255C%26disp%3dnsmdenvp185%255C%26nostale%255C%26color%3dblue%255C%26graph%5fstart%3d1568489816%255C%26graph%5fend%3d1568662616%255C%26graph%3dhourly%255C%26action%3dview&umid=656D8EA6-92B1-9705-83D0-CC28939636BB&auth=19120be9529b25014b618505cb01789c5433dae7-c5515d751c27d0f5b49b12d1513ad03efa095723>;
quoted from Jeremy Laidman
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>500 Internal Server Error</title>

This works for me (substituting my own Xymon servername, hostname and service.

</head><body>
<h1>Internal Server Error</h1>

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Jeremy Laidman · Thu, 19 Sep 2019 09:46:51 +1000 ·
Following your commands, the only suggestion is that the variables might
not have been set correctly. Perhaps run "echo $QUERY_STRING; echo
$REQUEST_METHOD; echo $SCRIPT_NAME" immediately before "$SCRIPT_NAME".

In case my instructions were amiss, here's another example of debugging
showgraph.sh to follow:

https://lists.xymon.com/archive/2012-July/035214.html

J

On Wed, 18 Sep 2019 at 04:32, Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
I must be doing something group here, neither worked:


$ SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET

root nsmdenvp117:/etc/xymon/analysis.d

$
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'


$ PATH=$PATH:/usr/lib64/xymon/cgi-bin

$ type showgraph.sh

showgraph.sh is /usr/lib64/xymon/cgi-bin/showgraph.sh

$ showgraph.sh

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>

$ export QUERY_STRING

$ export SCRIPTNAME

$ $SCRIPTNAME

$ export SCRIPT_NAME

$ $SCRIPT_NAME

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>

$
QUERY_STRING='host=nsmdenvp185&service=cpu&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'


$ $SCRIPT_NAME

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>

$ file /usr/lib64/xymon/cgi-bin/showgraph.sh

/usr/lib64/xymon/cgi-bin/showgraph.sh: ELF 64-bit LSB executable, x86-64,
version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux
2.6.18, stripped


*From:* Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
*Sent:* Monday, September 16, 2019 3:38 PM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


On Tue, 17 Sep 2019 at 05:53, Root, Paul T <user-76fdb6883669@xymon.invalid>
wrote:

Looping back on this:


Running the showgraph by hand


$ *./showgraph.sh host=nsmdenvp185 service=ncv:ConfigPulls
graph_width=576 graph_height=120 disp=nsmdenvp185 nostale color=blue
graph_start=1568489816 graph_end=1568662616 graph=hourly action=view*


This won't work. The showgraph.cgi binary expects to be run as a CGI and
requires QUERY_STRING to be set (to
host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=...) and
REQUEST_MATHOD to be set to "GET". It also expects SCRIPT_NAME to be set
(and normally it would be showgraph.sh) but I think this only generates
warnings.


Try running like so:


SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
./showgraph.sh


The output will be partly binary, so you might want to try:


SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
./showgraph.sh | sed '1,/^$/d' | file -


and see if it shows that a PNG file format was generated.


If this doesn't work, check for a service name such as "cpu" that is known
to work, rather than your custom "ncv:ConfigPulls".


Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>


Yep, cos no QUERY_STRING.


$ *ls /var/lib/xymon/rrd/nsmdenvp185/ConfigPulls**

/var/lib/xymon/rrd/nsmdenvp185/ConfigPulls.rrd

root nsmdenvp117:/usr/lib64/xymon/cgi-bin

$ cat ~ptroot/crap2

#!/bin/bash


$* curl -k
https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh\?host=nsmdenvp185\&service=ncv:ConfigPulls\&graph_width=576\&graph_height=120\&disp=nsmdenvp185\&nostale\&color=blue\&graph_start=1568489816\&graph_end=1568662616\&graph=hourly\&action=view

<https://imss91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2fnsmdenvp117.corp.intranet%2fxymon%2dcgi%2fshowgraph.sh%255C%3fhost%3dnsmdenvp185%255C%26service%3dncv%3aConfigPulls%255C%26graph%5fwidth%3d576%255C%26graph%5fheight%3d120%255C%26disp%3dnsmdenvp185%255C%26nostale%255C%26color%3dblue%255C%26graph%5fstart%3d1568489816%255C%26graph%5fend%3d1568662616%255C%26graph%3dhourly%255C%26action%3dview&umid=656D8EA6-92B1-9705-83D0-CC28939636BB&auth=19120be9529b25014b618505cb01789c5433dae7-c5515d751c27d0f5b49b12d1513ad03efa095723>*
quoted from Paul Root

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<html><head>

<title>500 Internal Server Error</title>


This works for me (substituting my own Xymon servername, hostname and
service.


</head><body>

<h1>Internal Server Error</h1>


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.
list Paul Root · Thu, 19 Sep 2019 17:03:01 +0000 ·
Ah, that got it.  I had REQUEST_METHOD=get on the same line as SCRIPT_NAME, effectively making the command ?showgraph REQUEST_METHOD=GET?

Also, the QUERY_STRING does not want the ncv: in it.

ConfigPulls yields:
$ $SCRIPT_NAME
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Unknown graph requested</body></html>

While cpu, and another custom graph we have (proc-mem) both work fine.

I?m thinking the upper case maybe causing the issue. I?m going to try to rename the test to lowercase.
quoted from Jeremy Laidman


From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
Sent: Wednesday, September 18, 2019 6:47 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid>
Cc: xymon at xymon.com
Subject: Re: [Xymon] Graphing in Xymon

Following your commands, the only suggestion is that the variables might not have been set correctly. Perhaps run "echo $QUERY_STRING; echo $REQUEST_METHOD; echo $SCRIPT_NAME" immediately before "$SCRIPT_NAME".

In case my instructions were amiss, here's another example of debugging showgraph.sh to follow:

https://lists.xymon.com/archive/2012-July/035214.html<https://imss91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2flists.xymon.com%2farchive%2f2012%2dJuly%2f035214.html&umid=53F7D197-92DC-7705-AA3B-96B005793723&auth=19120be9529b25014b618505cb01789c5433dae7-0da69dac38e7cd9a0ec0cb613ccf621beba4f183>;
quoted from Jeremy Laidman

J

On Wed, 18 Sep 2019 at 04:32, Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
I must be doing something group here, neither worked:

$ SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
root nsmdenvp117:/etc/xymon/analysis.d
$ QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
$ PATH=$PATH:/usr/lib64/xymon/cgi-bin
$ type showgraph.sh
showgraph.sh is /usr/lib64/xymon/cgi-bin/showgraph.sh
$ showgraph.sh
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>
$ export QUERY_STRING
$ export SCRIPTNAME
$ $SCRIPTNAME
$ export SCRIPT_NAME
$ $SCRIPT_NAME
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>
$ QUERY_STRING='host=nsmdenvp185&service=cpu&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
$ $SCRIPT_NAME
Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>
$ file /usr/lib64/xymon/cgi-bin/showgraph.sh
/usr/lib64/xymon/cgi-bin/showgraph.sh: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux 2.6.18, stripped

From: Jeremy Laidman <user-0608abae5e7c@xymon.invalid<mailto:user-0608abae5e7c@xymon.invalid>>
Sent: Monday, September 16, 2019 3:38 PM
To: Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>>
Cc: xymon at xymon.com<mailto:xymon at xymon.com>
Subject: Re: [Xymon] Graphing in Xymon

On Tue, 17 Sep 2019 at 05:53, Root, Paul T <user-76fdb6883669@xymon.invalid<mailto:user-76fdb6883669@xymon.invalid>> wrote:
Looping back on this:

Running the showgraph by hand

$ ./showgraph.sh host=nsmdenvp185 service=ncv:ConfigPulls graph_width=576 graph_height=120 disp=nsmdenvp185 nostale color=blue graph_start=1568489816 graph_end=1568662616 graph=hourly action=view

This won't work. The showgraph.cgi binary expects to be run as a CGI and requires QUERY_STRING to be set (to host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=...) and REQUEST_MATHOD to be set to "GET". It also expects SCRIPT_NAME to be set (and normally it would be showgraph.sh) but I think this only generates warnings.

Try running like so:

SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view' ./showgraph.sh

The output will be partly binary, so you might want to try:

SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view' ./showgraph.sh | sed '1,/^$/d' | file -

and see if it shows that a PNG file format was generated.

If this doesn't work, check for a service name such as "cpu" that is known to work, rather than your custom "ncv:ConfigPulls".


Content-type: text/html

<html><head><title>Invalid request</title></head>
<body>Invalid request - no host or service</body></html>

Yep, cos no QUERY_STRING.


$ ls /var/lib/xymon/rrd/nsmdenvp185/ConfigPulls*
/var/lib/xymon/rrd/nsmdenvp185/ConfigPulls.rrd
root nsmdenvp117:/usr/lib64/xymon/cgi-bin
$ cat ~ptroot/crap2
#!/bin/bash

$ curl -k https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh\?host=nsmdenvp185\&service=ncv:ConfigPulls\&graph_width=576\&graph_height=120\&disp=nsmdenvp185\&nostale\&color=blue\&graph_start=1568489816\&graph_end=1568662616\&graph=hourly\&action=view<https://imss91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2fnsmdenvp117.corp.intranet%2fxymon%2dcgi%2fshowgraph.sh%255C%3fhost%3dnsmdenvp185%255C%26service%3dncv%3aConfigPulls%255C%26graph%5fwidth%3d576%255C%26graph%5fheight%3d120%255C%26disp%3dnsmdenvp185%255C%26nostale%255C%26color%3dblue%255C%26graph%5fstart%3d1568489816%255C%26graph%5fend%3d1568662616%255C%26graph%3dhourly%255C%26action%3dview&umid=53F7D197-92DC-7705-AA3B-96B005793723&auth=19120be9529b25014b618505cb01789c5433dae7-99d13073304ea227297a4aef5b6bce69d989c333>;
quoted from Jeremy Laidman
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>500 Internal Server Error</title>

This works for me (substituting my own Xymon servername, hostname and service.

</head><body>
<h1>Internal Server Error</h1>

This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
This communication is the property of CenturyLink and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.
list Jeremy Laidman · Fri, 20 Sep 2019 10:01:20 +1000 ·
It's my understanding that the "service=XYZ" option is used to find a match
in graphs.cfg (ie [XYZ]). Usually this is the same string as the column
name, but sometimes not, and I have to admit that I don't fully understand
the relationships between RRD filename, graph name, column name, service
name, the variables TEST2RRD and GRAPHS and the per-host TRENDS settings.


On Fri, 20 Sep 2019 at 03:03, Root, Paul T <user-76fdb6883669@xymon.invalid>
quoted from Paul Root
wrote:
Ah, that got it.  I had REQUEST_METHOD=get on the same line as
SCRIPT_NAME, effectively making the command ?showgraph REQUEST_METHOD=GET?


Also, the QUERY_STRING does not want the ncv: in it.


ConfigPulls yields:

$ $SCRIPT_NAME

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Unknown graph requested</body></html>


While cpu, and another custom graph we have (proc-mem) both work fine.


I?m thinking the upper case maybe causing the issue. I?m going to try to
rename the test to lowercase.


*From:* Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
*Sent:* Wednesday, September 18, 2019 6:47 PM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


Following your commands, the only suggestion is that the variables might
not have been set correctly. Perhaps run "echo $QUERY_STRING; echo
$REQUEST_METHOD; echo $SCRIPT_NAME" immediately before "$SCRIPT_NAME".


In case my instructions were amiss, here's another example of debugging
showgraph.sh to follow:


https://lists.xymon.com/archive/2012-July/035214.html

<https://imss91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2flists.xymon.com%2farchive%2f2012%2dJuly%2f035214.html&umid=53F7D197-92DC-7705-AA3B-96B005793723&auth=19120be9529b25014b618505cb01789c5433dae7-0da69dac38e7cd9a0ec0cb613ccf621beba4f183>;
signature


J


On Wed, 18 Sep 2019 at 04:32, Root, Paul T <user-76fdb6883669@xymon.invalid>

quoted from Paul Root
wrote:

I must be doing something group here, neither worked:


$ SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET

root nsmdenvp117:/etc/xymon/analysis.d

$
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'


$ PATH=$PATH:/usr/lib64/xymon/cgi-bin

$ type showgraph.sh

showgraph.sh is /usr/lib64/xymon/cgi-bin/showgraph.sh

$ showgraph.sh

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>

$ export QUERY_STRING

$ export SCRIPTNAME

$ $SCRIPTNAME

$ export SCRIPT_NAME

$ $SCRIPT_NAME

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>

$
QUERY_STRING='host=nsmdenvp185&service=cpu&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'


$ $SCRIPT_NAME

Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>

$ file /usr/lib64/xymon/cgi-bin/showgraph.sh

/usr/lib64/xymon/cgi-bin/showgraph.sh: ELF 64-bit LSB executable, x86-64,
version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux
2.6.18, stripped


*From:* Jeremy Laidman <user-0608abae5e7c@xymon.invalid>
*Sent:* Monday, September 16, 2019 3:38 PM
*To:* Root, Paul T <user-76fdb6883669@xymon.invalid>
*Cc:* xymon at xymon.com
*Subject:* Re: [Xymon] Graphing in Xymon


On Tue, 17 Sep 2019 at 05:53, Root, Paul T <user-76fdb6883669@xymon.invalid>
wrote:

Looping back on this:


Running the showgraph by hand


$ *./showgraph.sh host=nsmdenvp185 service=ncv:ConfigPulls
graph_width=576 graph_height=120 disp=nsmdenvp185 nostale color=blue
graph_start=1568489816 graph_end=1568662616 graph=hourly action=view*


This won't work. The showgraph.cgi binary expects to be run as a CGI and
requires QUERY_STRING to be set (to
host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=...) and
REQUEST_MATHOD to be set to "GET". It also expects SCRIPT_NAME to be set
(and normally it would be showgraph.sh) but I think this only generates
warnings.


Try running like so:


SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
./showgraph.sh


The output will be partly binary, so you might want to try:


SCRIPT_NAME=showgraph.sh REQUEST_METHOD=GET
QUERY_STRING='host=nsmdenvp185&service=ncv:ConfigPulls&graph_width=576&graph_height=120&disp=nsmdenvp185&nostale&color=blue&graph_start=1568489816&graph_end=1568662616&graph=hourly&action=view'
./showgraph.sh | sed '1,/^$/d' | file -


and see if it shows that a PNG file format was generated.


If this doesn't work, check for a service name such as "cpu" that is known
to work, rather than your custom "ncv:ConfigPulls".


Content-type: text/html


<html><head><title>Invalid request</title></head>

<body>Invalid request - no host or service</body></html>


Yep, cos no QUERY_STRING.


$ *ls /var/lib/xymon/rrd/nsmdenvp185/ConfigPulls**

/var/lib/xymon/rrd/nsmdenvp185/ConfigPulls.rrd

root nsmdenvp117:/usr/lib64/xymon/cgi-bin

$ cat ~ptroot/crap2

#!/bin/bash


$* curl -k
https://nsmdenvp117.corp.intranet/xymon-cgi/showgraph.sh\?host=nsmdenvp185\&service=ncv:ConfigPulls\&graph_width=576\&graph_height=120\&disp=nsmdenvp185\&nostale\&color=blue\&graph_start=1568489816\&graph_end=1568662616\&graph=hourly\&action=view

<https://imss91-ctp.trendmicro.com:443/wis/clicktime/v1/query?url=https%3a%2f%2fnsmdenvp117.corp.intranet%2fxymon%2dcgi%2fshowgraph.sh%255C%3fhost%3dnsmdenvp185%255C%26service%3dncv%3aConfigPulls%255C%26graph%5fwidth%3d576%255C%26graph%5fheight%3d120%255C%26disp%3dnsmdenvp185%255C%26nostale%255C%26color%3dblue%255C%26graph%5fstart%3d1568489816%255C%26graph%5fend%3d1568662616%255C%26graph%3dhourly%255C%26action%3dview&umid=53F7D197-92DC-7705-AA3B-96B005793723&auth=19120be9529b25014b618505cb01789c5433dae7-99d13073304ea227297a4aef5b6bce69d989c333>*
quoted from Paul Root

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<html><head>

<title>500 Internal Server Error</title>


This works for me (substituting my own Xymon servername, hostname and
service.


</head><body>

<h1>Internal Server Error</h1>


This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.

This communication is the property of CenturyLink and may contain
confidential or privileged information. Unauthorized use of this
communication is strictly prohibited and may be unlawful. If you have
received this communication in error, please immediately notify the sender
by reply e-mail and destroy all copies of the communication and any
attachments.