Xymon Mailing List Archive search

I need help troubleshooting a xymon issue

5 messages in this thread

list David Hickenbottom · Wed, 31 Jul 2019 12:00:54 +0000 ·
Hi,

First of all Thank You!  This is a fantastic product.  I have two problems.  The first is with regards to SSL monitoring.  I have a group of 20 or so webservers.  Half monitor the SSL certificate correctly, the others act like they do not see one.
[cid:image001.png at 01D54776.1322ABD0]

It looks good from every way I can look at it, but Xymon is not happy!  Is there a way for me to see what is going on?

This second problem, although not a big issue, some of our servers report back an extremely large client file - the active connections list is so long the complete file does not get ingested.  I have tried changing the max lines parameter, but that had not made any difference.  On some of them I changed to order of the report so the data that is typically after the ports section is ingested and the ports data is dropped off.  Losing part of the ports data  does not appear to cause a problem and I cannot tell by the current monitors I am even missing data.  (it would be interesting to see how many connections  -  listening, established and waiting - are reported).

Best regards,
David Hickenbottom
list David Hickenbottom · Wed, 31 Jul 2019 12:12:03 +0000 ·
The second problem below caused purple alerts.  Changing the order fixed it and have not seen purple alerts since.
quoted from David Hickenbottom

From: David Hickenbottom
Sent: Wednesday, July 31, 2019 8:01 AM
To: xymon at xymon.com
Subject: I need help troubleshooting a xymon issue

Hi,

First of all Thank You!  This is a fantastic product.  I have two problems.  The first is with regards to SSL monitoring.  I have a group of 20 or so webservers.  Half monitor the SSL certificate correctly, the others act like they do not see one.

[cid:image001.png at 01D54777.A22D5D60]
quoted from David Hickenbottom

It looks good from every way I can look at it, but Xymon is not happy!  Is there a way for me to see what is going on?

This second problem, although not a big issue, some of our servers report back an extremely large client file - the active connections list is so long the complete file does not get ingested.  I have tried changing the max lines parameter, but that had not made any difference.  On some of them I changed to order of the report so the data that is typically after the ports section is ingested and the ports data is dropped off.  Losing part of the ports data  does not appear to cause a problem and I cannot tell by the current monitors I am even missing data.  (it would be interesting to see how many connections  -  listening, established and waiting - are reported).

Best regards,
David Hickenbottom
list Adam Thorn · Wed, 31 Jul 2019 16:07:18 +0100 ·
quoted from David Hickenbottom
On 31/07/2019 13:00, David Hickenbottom wrote:
Hi,

First of all Thank You!? This is a fantastic product.? I have two problems.? The first is with regards to SSL monitoring.? I have a group of 20 or so webservers.? Half monitor the SSL certificate correctly, the others act like they do not see one.

It looks good from every way I can look at it, but Xymon is not happy!  Is there a way for me to see what is going on?
Bit of a guess here: do you need to use SNI (https://en.wikipedia.org/wiki/Server_Name_Indication) for the hosts where the test fails? Assuming this is the built in sslcert test performed by xymonnet, you can run it yourself with e.g.

/usr/lib/xymon/server/bin/xymonnet pr26.imbills.com --noping --no-update

where --no-update will print the test output to stdout rather than reporting to your xymon server. (NB that'll run all the xymonnet tests, not just sslcert) If you need SNI, you can add --sni=on to that command as a test, and/or add "sni" to the relevant line in hosts.cfg.

You can also add --debug to the above xymonnet command, which might or might not give you information about the failure.

Adam
list Timothy Williams · Wed, 31 Jul 2019 11:35:08 -0400 ·
You did not specify what OS and client this pertains to. On the assumption
it is Windows using the powershell client, the second issue was fixed after
about version 2.28 by a client-local keyword of PORTS:listenonly which
limits the ports information to only the listening ports; all of the
'established' info is discarded. This cuts the size of the data file down a
lot.

We are also dealing with the first issue of invalid SSL connections on the
HTTP tests for some servers. My observation of the underlying ciphers on
the affected servers is that they were recently security-tightened to only
include "forward-secrecy" ciphers, and I think that the Xymon server can't
handshake using only those. Successful handshakes are
using ECDHE-RSA-AES256-GCM-SHA384, while failing
have ECDHE_RSA_WITH_AES_256_CBC_SHA384 (only the CBC variant).

Tim Williams
VCU Computing Center
quoted from Adam Thorn


On Wed, Jul 31, 2019 at 11:22 AM Adam Thorn <user-f6b877930936@xymon.invalid> wrote:
On 31/07/2019 13:00, David Hickenbottom wrote:
Hi,

First of all Thank You!  This is a fantastic product.  I have two
problems.  The first is with regards to SSL monitoring.  I have a group
of 20 or so webservers.  Half monitor the SSL certificate correctly, the
others act like they do not see one.

It looks good from every way I can look at it, but Xymon is not happy!
Is there a way for me to see what is going on?
Bit of a guess here: do you need to use SNI
(https://en.wikipedia.org/wiki/Server_Name_Indication) for the hosts
where the test fails? Assuming this is the built in sslcert test
performed by xymonnet, you can run it yourself with e.g.

/usr/lib/xymon/server/bin/xymonnet pr26.imbills.com --noping --no-update

where --no-update will print the test output to stdout rather than
reporting to your xymon server. (NB that'll run all the xymonnet tests,
not just sslcert) If you need SNI, you can add --sni=on to that command
as a test, and/or add "sni" to the relevant line in hosts.cfg.

You can also add --debug to the above xymonnet command, which might or
might not give you information about the failure.

Adam

list David Hickenbottom · Wed, 31 Jul 2019 19:47:28 +0000 ·
Adam Thorn,

Thank you! The SNI tag worked (the command line returned a lot of stuff, nothing of value - looked the same with a working and non-working webserver.

Tim Williams,
That is good to know.  I will look for the new ps client.

Thank you all

David
quoted from David Hickenbottom

From: David Hickenbottom
Sent: Wednesday, July 31, 2019 8:12 AM
To: xymon at xymon.com
Subject: RE: I need help troubleshooting a xymon issue

The second problem below caused purple alerts.  Changing the order fixed it and have not seen purple alerts since.

From: David Hickenbottom
Sent: Wednesday, July 31, 2019 8:01 AM
To: xymon at xymon.com<mailto:xymon at xymon.com>
Subject: I need help troubleshooting a xymon issue

Hi,

First of all Thank You!  This is a fantastic product.  I have two problems.  The first is with regards to SSL monitoring.  I have a group of 20 or so webservers.  Half monitor the SSL certificate correctly, the others act like they do not see one.

[cid:user-c881cbe18d0b@xymon.invalid494CF0]
quoted from David Hickenbottom

It looks good from every way I can look at it, but Xymon is not happy!  Is there a way for me to see what is going on?

This second problem, although not a big issue, some of our servers report back an extremely large client file - the active connections list is so long the complete file does not get ingested.  I have tried changing the max lines parameter, but that had not made any difference.  On some of them I changed to order of the report so the data that is typically after the ports section is ingested and the ports data is dropped off.  Losing part of the ports data  does not appear to cause a problem and I cannot tell by the current monitors I am even missing data.  (it would be interesting to see how many connections  -  listening, established and waiting - are reported).

Best regards,
David Hickenbottom