Xymon Mailing List Archive search

xymon replacement in python

9 messages in this thread

list Corentin Labbe · Mon, 14 Aug 2023 21:37:15 +0200 ·
Hello

I am a big fan of xymon, and I was sad of its current maintainer status.
I could have steped as maintainer of it, but the current state of the C code let me fear to lack enough time to masterize it.
It will take days just to fix all string management warnings reported by gcc.
I tryed to fix some issues and the result could be seen at https://github.com/xython-monitoring/xymon

But I have asked myself, the protocol behing xymon is simple, why not trying to do it in python ?
My personnal needs is a little subset of what xymon support, so I started to emulate xymon in python as a PoC just to see how long it will be.
In a few hours I was able to emulate basic parts and I was more confident to step further.

So I decided to publish my current code, but I fear to publish something too early, I pray that some people could find it usefull.

I tried to document at maximum, how to test it, but I am very bad at it.
You can find the current result at https://github.com/xython-monitoring/xython

I started this some month ago and the milestones are already obsolete, I will update them.

But before progressing farther, I have still some interogation on how to handle some part.
It will be kind if some people share some informations about how they use xymon.
I am very interested about:
- number of clients (what is the greatest number of clients possible ?)
- number of hosts ? messages per second ?
- number of network tests

Thanks
list Scot Kreienkamp · Mon, 14 Aug 2023 19:47:14 +0000 ·
We have 1 server, 685 clients, 722 hosts for network tests, 1144 total tests currently, with a cycle time of 60 seconds. XymonD is receiving around 120 messages per second. Display is running as its own dedicated server and network tests are running on a second dedicated server.

Scot Kreienkamp | Senior Linux Systems Engineer | La-Z-Boy Corporate
One La-Z-Boy Drive | Monroe, Michigan 48162 | ( (XXX) XXX-XXXX | | ) X-XXX-XXX-XXXX | * user-9678697f1438@xymon.invalid
www.la-z-boy.com | facebook.com/lazboy | twitter.com/lazboy | youtube.com/lazboy



-----Original Message-----
From: Xymon On Behalf Of Corentin Labbe
Sent: Monday, August 14, 2023 3:37 PM
To: xymon@xymon.com
Subject: [Xymon] xymon replacement in python

[You don't often get email from user-1b1b786139f5@xymon.invalid. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]

quoted from Corentin Labbe
Hello

I am a big fan of xymon, and I was sad of its current maintainer status.
I could have steped as maintainer of it, but the current state of the C code let me fear to lack enough time to masterize it.
It will take days just to fix all string management warnings reported by gcc.
I tryed to fix some issues and the result could be seen at https://github.com/xython-monitoring/xymon

But I have asked myself, the protocol behing xymon is simple, why not trying to do it in python ?
My personnal needs is a little subset of what xymon support, so I started to emulate xymon in python as a PoC just to see how long it will be.
In a few hours I was able to emulate basic parts and I was more confident to step further.

So I decided to publish my current code, but I fear to publish something too early, I pray that some people could find it usefull.

I tried to document at maximum, how to test it, but I am very bad at it.
You can find the current result at https://github.com/xython-monitoring/xython

I started this some month ago and the milestones are already obsolete, I will update them.

But before progressing farther, I have still some interogation on how to handle some part.
It will be kind if some people share some informations about how they use xymon.
I am very interested about:
- number of clients (what is the greatest number of clients possible ?)
- number of hosts ? messages per second ?
- number of network tests

Thanks

Xymon@xymon.com

This message is intended only for the individual or entity to which it is addressed. It may contain privileged, confidential information which is exempt from disclosure under applicable laws. If you are not the intended recipient, you are strictly prohibited from disseminating or distributing this information (other than to the intended recipient) or copying this information. If you have received this communication in error, please notify us immediately by e-mail or by telephone at the above number. Thank you.

list Josh Luthman · Mon, 14 Aug 2023 21:36:32 -0400 ·
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list

On Mon, Aug 14, 2023 at 3:47?PM Scot Kreienkamp <
quoted from Scot Kreienkamp
user-9678697f1438@xymon.invalid> wrote:
We have 1 server, 685 clients, 722 hosts for network tests, 1144 total
tests currently, with a cycle time of 60 seconds.  XymonD is receiving
around 120 messages per second.  Display is running as its own dedicated
server and network tests are running on a second dedicated server.

*Scot Kreienkamp | Senior Linux Systems Engineer | La-Z-Boy Corporate*
One La-Z-Boy Drive | Monroe, Michigan 48162 | ( (XXX) XXX-XXXX | |  )
X-XXX-XXX-XXXX  | * user-9678697f1438@xymon.invalid
www.la-z-boy.com  | facebook.com/lazboy  | twitter.com/lazboy |
youtube.com/lazboy

[image: Smaller LZB Only Logo for Sign.png]
quoted from Corentin Labbe


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Corentin Labbe
Sent: Monday, August 14, 2023 3:37 PM
To: xymon at xymon.com
Subject: [Xymon] xymon replacement in python

[You don't often get email from user-1b1b786139f5@xymon.invalid. Learn why this
is important at https://aka.ms/LearnAboutSenderIdentification ]

Hello

I am a big fan of xymon, and I was sad of its current maintainer status.
I could have steped as maintainer of it, but the current state of the C
code let me fear to lack enough time to masterize it.
It will take days just to fix all string management warnings reported by
gcc.
I tryed to fix some issues and the result could be seen at
https://github.com/xython-monitoring/xymon

But I have asked myself, the protocol behing xymon is simple, why not
trying to do it in python ?
My personnal needs is a little subset of what xymon support, so I started
to emulate xymon in python as a PoC just to see how long it will be.
In a few hours I was able to emulate basic parts and I was more confident
to step further.

So I decided to publish my current code, but I fear to publish something
too early, I pray that some people could find it usefull.

I tried to document at maximum, how to test it, but I am very bad at it.
You can find the current result at
https://github.com/xython-monitoring/xython

I started this some month ago and the milestones are already obsolete, I
will update them.

But before progressing farther, I have still some interogation on how to
handle some part.
It will be kind if some people share some informations about how they use
xymon.
I am very interested about:
- number of clients (what is the greatest number of clients possible ?)
- number of hosts ? messages per second ?
- number of network tests

Thanks


This message is intended only for the individual or entity to which it is
addressed. It may contain privileged, confidential information which is
exempt from disclosure under applicable laws. If you are not the intended
recipient, you are strictly prohibited from disseminating or distributing
this information (other than to the intended recipient) or copying this
information. If you have received this communication in error, please
notify us immediately by e-mail or by telephone at the above number. Thank
you.

list Ralph Mitchell · Tue, 15 Aug 2023 02:50:53 -0400 ·
The EDS/Oklahoma entry in that list is probably no longer true.  I was
responsible for it up until being laid off in 2009 and prior to that  they
were working desperately to change it over to CA Unicenter.  The HP
integration people handed me a couple of Unicenter scripts that they
thought would replace a couple of Xymon test.  I gave them chapter and
verse of why it would not work.  Oddly, I never heard back,..

There's a new entry for Virginia - The Navy Exchange, probably about 2500
hosts, no idea how many tests.

Ralph Mitchell


On Mon, Aug 14, 2023 at 9:47?PM Josh Luthman <user-4c45a83f15cb@xymon.invalid>
quoted from Josh Luthman
wrote:
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list

On Mon, Aug 14, 2023 at 3:47?PM Scot Kreienkamp <
user-9678697f1438@xymon.invalid> wrote:
We have 1 server, 685 clients, 722 hosts for network tests, 1144 total
tests currently, with a cycle time of 60 seconds.  XymonD is receiving
around 120 messages per second.  Display is running as its own dedicated
server and network tests are running on a second dedicated server.

*Scot Kreienkamp | Senior Linux Systems Engineer | La-Z-Boy Corporate*
One La-Z-Boy Drive | Monroe, Michigan 48162 | ( (XXX) XXX-XXXX | |  )
X-XXX-XXX-XXXX  | * user-9678697f1438@xymon.invalid
www.la-z-boy.com  | facebook.com/lazboy  | twitter.com/lazboy |
youtube.com/lazboy
[image: Smaller LZB Only Logo for Sign.png]


-----Original Message-----
From: Xymon <xymon-bounces at xymon.com> On Behalf Of Corentin Labbe
Sent: Monday, August 14, 2023 3:37 PM
To: xymon at xymon.com
Subject: [Xymon] xymon replacement in python

[You don't often get email from user-1b1b786139f5@xymon.invalid. Learn why
this is important at https://aka.ms/LearnAboutSenderIdentification ]

Hello

I am a big fan of xymon, and I was sad of its current maintainer status.
I could have steped as maintainer of it, but the current state of the C
code let me fear to lack enough time to masterize it.
It will take days just to fix all string management warnings reported by
gcc.
I tryed to fix some issues and the result could be seen at
https://github.com/xython-monitoring/xymon

But I have asked myself, the protocol behing xymon is simple, why not
trying to do it in python ?
My personnal needs is a little subset of what xymon support, so I started
to emulate xymon in python as a PoC just to see how long it will be.
In a few hours I was able to emulate basic parts and I was more confident
to step further.

So I decided to publish my current code, but I fear to publish something
too early, I pray that some people could find it usefull.

I tried to document at maximum, how to test it, but I am very bad at it.
You can find the current result at
https://github.com/xython-monitoring/xython

I started this some month ago and the milestones are already obsolete, I
will update them.

But before progressing farther, I have still some interogation on how to
handle some part.
It will be kind if some people share some informations about how they use
xymon.
I am very interested about:
- number of clients (what is the greatest number of clients possible ?)
- number of hosts ? messages per second ?
- number of network tests

Thanks


This message is intended only for the individual or entity to which it is
addressed. It may contain privileged, confidential information which is
exempt from disclosure under applicable laws. If you are not the intended
recipient, you are strictly prohibited from disseminating or distributing
this information (other than to the intended recipient) or copying this
information. If you have received this communication in error, please
notify us immediately by e-mail or by telephone at the above number. Thank
you.

list Corentin Labbe · Wed, 23 Aug 2023 19:51:12 +0200 ·
Le Mon, Aug 14, 2023 at 09:36:32PM -0400, Josh Luthman a ?crit :
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list
Thanks for the link

It seems the maximum is 10000 hosts and not on a simple server (but on a cluster of xymon server).
Someone is reporting 500000 hosts, but without more information ....
list Josh Luthman · Wed, 23 Aug 2023 15:56:27 -0400 ·
For those that don't want to scroll through, 10k and 500k are the biggest
but they are certainly outliers.

# curl -s "
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list"|grep
Hosts|awk 'NF>1{print $NF}'|sort -V|tail
2247
2406
3062
3949
5339
5372
10940
569869

How many hosts are you looking to monitor?

On Wed, Aug 23, 2023 at 1:51?PM Corentin Labbe <user-1b1b786139f5@xymon.invalid>
quoted from Corentin Labbe
wrote:
Le Mon, Aug 14, 2023 at 09:36:32PM -0400, Josh Luthman a ?crit :
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list
Thanks for the link

It seems the maximum is 10000 hosts and not on a simple server (but on a
cluster of xymon server).
Someone is reporting 500000 hosts, but without more information ....
list Corentin Labbe · Wed, 23 Aug 2023 22:29:18 +0200 ·
Le Wed, Aug 23, 2023 at 03:56:27PM -0400, Josh Luthman a ?crit :
quoted from Josh Luthman
For those that don't want to scroll through, 10k and 500k are the biggest
but they are certainly outliers.

# curl -s "
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list"|grep
Hosts|awk 'NF>1{print $NF}'|sort -V|tail
2247
2406
3062
3949
5339
5372
10940
569869

How many hosts are you looking to monitor?
For my own personnal case no more than hundreds.

But for my xython project, I want to know how far I need to bench to reach (or for dreaming exceed) xymon performance.

But the problem for this list, it state only hosts and not number of tests per hosts.
This is not the same than just 1000 host with just ping test and 1000 hosts with 10 network tests AND 20 "columns".

Regards
list Japheth Cleaver · Wed, 23 Aug 2023 13:39:21 -0700 ·
I believe ServiceNow has since moved on from Xymon as the core monitoring
system, but I am curious what the host load did peak at.

FTR, those were hosts in the xymon sense of the word, not individual
machines or VMs. I.e., application nodes and database instances were
tracked separately as pseudo-hosts, not that xymond particularly cared.

-jc
quoted from Josh Luthman


On Wed, August 23, 2023 12:56, Josh Luthman wrote:
For those that don't want to scroll through, 10k and 500k are the biggest
but they are certainly outliers.

# curl -s "
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list"|grep
Hosts|awk 'NF>1{print $NF}'|sort -V|tail
2247
2406
3062
3949
5339
5372
10940
569869

How many hosts are you looking to monitor?

On Wed, Aug 23, 2023 at 1:51???PM Corentin Labbe
<user-1b1b786139f5@xymon.invalid>
wrote:
Le Mon, Aug 14, 2023 at 09:36:32PM -0400, Josh Luthman a ??crit :
https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The_Xymon_Users_list
Thanks for the link

It seems the maximum is 10000 hosts and not on a simple server (but on a
cluster of xymon server).
Someone is reporting 500000 hosts, but without more information ....
list Stephane Bakhos · Wed, 23 Aug 2023 21:00:43 +0000 () ·
On Wed, 23 Aug 2023, Corentin Labbe wrote:
Le Wed, Aug 23, 2023 at 03:56:27PM -0400, Josh Luthman a =E9crit :
quoted from Japheth Cleaver
For those that don't want to scroll through, 10k and 500k are the biggest
but they are certainly outliers.
=
# curl -s "

https://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/User_Guide/The=
_Xymon_Users_list"|grep
quoted from Corentin Labbe
Hosts|awk 'NF>1{print $NF}'|sort -V|tail
2247
2406
3062
3949
5339
5372
10940
569869
=
How many hosts are you looking to monitor?
=

For my own personnal case no more than hundreds.

But for my xython project, I want to know how far I need to bench to reach =
(or for dreaming exceed) xymon performance.

But the problem for this list, it state only hosts and not number of tests =
per hosts.
This is not the same than just 1000 host with just ping test and 1000 hosts=
 with 10 network tests AND 20 "columns".
I've got about 2500 hosts ( in the xymon sense ). A large chunk are fake hosts for functionnal monitoring. A host ranges from 5 to 25 columns. Tests run every 5 minutes.

There is also a Vpage host that has ~2000 columns.

Load wise, the xymon server is on a VM with 8 vCPU and 8gb of RAM. Only 596Mb of RAM is actually counted as used by processes, and that would include apache and everything else.

The only thing that has been clunky is the multi-server failover, but it works well enough.