xymon ready to replace bb?
list Joe Sloan
After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe
list Ralph Mitchell
Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell
▸
On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote:
After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe
list Harald Husemann
Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh
▸
Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe
--
Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
list Martin Flemming
Hi, Harald !
Xymon with Linux HA cluster with DRBD
did you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid
▸
On Thu, 26 Mar 2009, Husemann, Harald wrote:
Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe-- Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
list Galen Johnson
While I don't want to minimize TJ's work, I don't believe people realize that Xymonton, the Xymon repository for custom tests, is actually built on top of Dokuwiki. This is exactly the type of information the tutorials page was meant to capture. It might be helpful if we had a one stop shop for all things Xymon instead of going one place for scripts and another for docs. Just my 2 cents (not that I have any vested interest in this ;-) ) =G=
▸
-----Original Message-----
From: Martin Flemming [mailto:user-f286aaa49a76@xymon.invalid]
Sent: Thursday, March 26, 2009 6:20 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] xymon ready to replace bb?
Hi, Harald !
Xymon with Linux HA cluster with DRBD
did you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:
Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe-- Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
list Martin Flemming
Grmph, you're right, one place for all is the best solution .. Me for myself, i switch from side to side ... and would prefer on central Side, too ! ... by the way, the wiki-side from TJ is very well and comprehensive ... there will be a lot of things to merge into the "offical" Xymonton ... martin
▸
On Thu, 26 Mar 2009, Galen Johnson wrote:
While I don't want to minimize TJ's work, I don't believe people realize that Xymonton, the Xymon repository for custom tests, is actually built on top of Dokuwiki. This is exactly the type of information the tutorials page was meant to capture. It might be helpful if we had a one stop shop for all things Xymon instead of going one place for scripts and another for docs. Just my 2 cents (not that I have any vested interest in this ;-) ) =G= -----Original Message----- From: Martin Flemming [mailto:user-f286aaa49a76@xymon.invalid] Sent: Thursday, March 26, 2009 6:20 AM To: user-ae9b8668bcde@xymon.invalid Subject: Re: [hobbit] xymon ready to replace bb? Hi, Harald !Xymon with Linux HA cluster with DRBDdid you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe-- Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
Gruss
Martin Flemming
▸
Martin Flemming
DESY / IT office : Building 2b / 008a
Notkestr. 85 phone : XXX - XXXX - XXXX
22603 Hamburg mail : user-f286aaa49a76@xymon.invalid
list Galen Johnson
I don't mind. It doesn't have to happen overnight. :-) Who needs sleep?
▸
-----Original Message-----
From: Martin Flemming [mailto:user-f286aaa49a76@xymon.invalid]
Sent: Thursday, March 26, 2009 10:45 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] xymon ready to replace bb?
Grmph,
you're right, one place for all is the best solution ..
Me for myself,
i switch from side to side ... and would prefer on central Side, too !
... by the way, the wiki-side from TJ is very well and comprehensive ...
there will be a lot of things to merge into the "offical" Xymonton ...
martin
On Thu, 26 Mar 2009, Galen Johnson wrote:
While I don't want to minimize TJ's work, I don't believe people realize that Xymonton, the Xymon repository for custom tests, is actually built on top of Dokuwiki. This is exactly the type of information the tutorials page was meant to capture. It might be helpful if we had a one stop shop for all things Xymon instead of going one place for scripts and another for docs. Just my 2 cents (not that I have any vested interest in this ;-) ) =G= -----Original Message----- From: Martin Flemming [mailto:user-f286aaa49a76@xymon.invalid] Sent: Thursday, March 26, 2009 6:20 AM To: user-ae9b8668bcde@xymon.invalid Subject: Re: [hobbit] xymon ready to replace bb? Hi, Harald !Xymon with Linux HA cluster with DRBDdid you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe-- Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
Gruss
Martin Flemming
Martin Flemming
DESY / IT office : Building 2b / 008a
Notkestr. 85 phone : XXX - XXXX - XXXX
22603 Hamburg mail : user-f286aaa49a76@xymon.invalid
list Joe Sloan
▸
Husemann, Harald wrote:
Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us.
That would be a rather disruptive and expensive change. Since bb's failover capability has been working perfectly since 2005, it would be a hard sell in this economic climate to convince management to shell out money to build 5 clusters. They'll tell me "forget it, let's stay with big brother" It would be tricky to do in our situation also because a cluster would typically be built from machines in the same lan. Trying to build a cluster of machines on completely different networks as ours are, would be a bit more challenging, since neither side could take over an IP from the other. I will admit, that if I was building something new from scratch, your idea would be the way to go. But unfortunately the company has become dependent on some specific features of big brother, thus my search for a drop-in replacement. Joe
list Stef Coene
▸
On Thursday 26 March 2009, J Sloan wrote:
2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005.
For the failover, configure both servers to report to each other it's situation. Configure both servers to trigger a script when there is an alert. Except one of them is the master and is always sending out the alert. The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green. So, basically, both servers are triggering on the same alert, but the slave server only sends out the alert if the primary server is not green. Stef
list Malcolm Hunter
▸
The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green. So, basically, both servers are triggering on the same alert, but the slave server only sends out the alert if the primary server is not green.
Wouldn't there be more involved in this? What if the primary server's hobbit daemon was down, but the web service was still running? The secondary server would want to report the hobbit daemon being down, but wouldn't because the primary server's page was still green and hadn't been updated. Regards, Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Neu: GMX FreeDSL Komplettanschluss mit DSL 6.000 Flatrate + Telefonanschluss für nur 17,95 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a
list Ralph Mitchell
▸
On Thu, Mar 26, 2009 at 5:53 PM, Malcolm Hunter <user-b3e590ffeb6d@xymon.invalid>wrote:
The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green. So, basically, both servers are triggering on the same alert, but the slave server only sends out the alert if the primary server is not green.Wouldn't there be more involved in this? What if the primary server's hobbit daemon was down, but the web service was still running? The secondary server would want to report the hobbit daemon being down, but wouldn't because the primary server's page was still green and hadn't been updated.
The hobbit pages have a time stamp in the title, so the slave can grab the page, grep for <title>, extract the date, convert to seconds using gnudate. Then the slave gets its own timestamp in seconds, subtracts the primary's time and complains if there's more than a couple of minutes difference. That timestamp doesn't update if the hobbit daemon is down. Ralph Mitchell
list Dan McDonald
▸
On Thu, 2009-03-26 at 18:31 -0500, Ralph Mitchell wrote:
On Thu, Mar 26, 2009 at 5:53 PM, Malcolm Hunter <user-b3e590ffeb6d@xymon.invalid> wrote:The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green.
Why not point the master's client to the slave, and if bbd goes red/purple, then take over....
-- Daniel J McDonald, CCIE #2495, CISSP #78281, CNX Austin Energy http://www.austinenergy.com
list D. - Gdi/snb Kip
▸
-----Oorspronkelijk bericht----- Van: McDonald, Dan [mailto:user-290ce4e24e19@xymon.invalid] Verzonden: vrijdag 27 maart 2009 0:40 Aan: user-ae9b8668bcde@xymon.invalid Onderwerp: Re: [hobbit] xymon ready to replace bb? On Thu, 2009-03-26 at 18:31 -0500, Ralph Mitchell wrote:
On Thu, Mar 26, 2009 at 5:53 PM, Malcolm Hunter <user-b3e590ffeb6d@xymon.invalid> wrote:The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green.
Why not point the master's client to the slave, and if bbd goes red/purple, then take over....
Do you have a sample configuration for this? I'd be interested...
list Stef Coene
▸
On Thursday 26 March 2009, Malcolm Hunter wrote:
The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green. So, basically, both servers are triggering on the same alert, but the slave server only sends out the alert if the primary server is not green.Wouldn't there be more involved in this? What if the primary server's hobbit daemon was down, but the web service was still running? The secondary server would want to report the hobbit daemon being down, but wouldn't because the primary server's page was still green and hadn't been updated.
Not if you let the master hobbit send it status to the slave hobbit and check the status on the slace hobbit. If the master hobbit is down, the slave hobbit will become purple. It is possible that you miss some alerts. If I need to do something like this, I would create a custom test that does some more advanced checking (Can I send an alert? Can I rech my smtp server? ...). The status is send to the other hobbit server and can be used to trigger a failover in alerting. Stef
list Buchan Milne
▸
On Friday 27 March 2009 00:25:53 Stef Coene wrote:
For the failover, configure both servers to report to each other it's situation. Configure both servers to trigger a script when there is an alert. Except one of them is the master and is always sending out the alert. The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green.
I would rather: bb $MASTERDISPLAY 'query $MASTERDISPLAY.bbd'|grep -q ^green || enable_hobbitd_alert (where implementation of enable_hobbitd_alert is left as an exercise for the reader)
list Harald Husemann
Hi Martin, I can of course write a doc about our setup to share my experiences. As I saw, there was a bit of a discussion about the right place for it, so, question to the list: Where shall I upload it? Or shall I send it directly to the list, and someone (TJ?) picks it + includes it? hh
▸
Martin Flemming schrieb:Hi, Harald !Xymon with Linux HA cluster with DRBDdid you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe-- Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
-- Harald Husemann Netzwerk- und Systemadministrator Operation Management Center (OMC) MATERNA GmbH Information & Communications Westfalendamm 98 44141 Dortmund Geschäftsführer: Dr. Winfried Materna, Helmut an de Meulen, Ralph Hartwig Amtsgericht Dortmund HRB 5839 Tel: +XX XXX XXXX XXX Fax: +XX XXX XXXX XXX www.annyway.com <http://www.annyway.com/>; www.materna.com <http://www.materna.com/>;
list Dan McDonald
▸
On Fri, 2009-03-27 at 09:50 +0200, Buchan Milne wrote:
On Friday 27 March 2009 00:25:53 Stef Coene wrote:For the failover, configure both servers to report to each other it's situation. Configure both servers to trigger a script when there is an alert. Except one of them is the master and is always sending out the alert. The other (the slave one) first checks the status of the other server (a simpel wget of the status page can be enough) and only sends out the alert if this page is not green.I would rather: bb $MASTERDISPLAY 'query $MASTERDISPLAY.bbd'|grep -q ^green || enable_hobbitd_alert (where implementation of enable_hobbitd_alert is left as an exercise for the reader)
I was thinking the depends=($MASTERDISPLAY/bbd) syntax, but on further inspection, I don't think that will cut it. -- Daniel J McDonald, CCIE #2495, CISSP #78281, CNX Austin Energy http://www.austinenergy.com
list Scot Kreienkamp
Hi everyone, I've setup a custom script to return several values that are being entered into the same RRD by xymon. I'd like to graph those values, but the values differ by thousands so I can't really put them on the same graph. Is there any way to generate multiple graphs on a single test page? I see there are several vmstat tests like vmstat1, vmstat2, etc. Would I be able to use that format to give me more than one graph? Also, in hobbitserver.cfg there is a value for mrtg like this: mrtg::1. I can't find any explanation of the significance of the double colon. Can anyone fill me in? BTW, I just changed from BB commercial edition to Xymon. Xymon fixes everything I always disliked about BB, not to mention that Quest has virtually halted development on BB since it purchased it. Thanks, Scot Kreienkamp La-Z-Boy Inc.
list Martin Flemming
Hi, Harald ! .. good question ... but it should not be a religious question .. :-) .. but i think, in both ways, you need a registration for the rights to append your notes ... So obvisously, it should the best way for all Xymon's to have one and only Wiki/Howto Side ... For Xymonton would be Galen the right person ....
Or shall I send it directly to the list
hmm, maybe the quickest solution ... thanks & cheers, martin
▸
On Fri, 27 Mar 2009, Husemann, Harald wrote:
Hi Martin, I can of course write a doc about our setup to share my experiences. As I saw, there was a bit of a discussion about the right place for it, so, question to the list: Where shall I upload it? Or shall I send it directly to the list, and someone (TJ?) picks it + includes it? hh Martin Flemming schrieb:Hi, Harald !Xymon with Linux HA cluster with DRBDdid you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:Hi,for the failover part, what about using a real cluster like Linux HA > cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb: Take a look at the Xymon alert man page:http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The > > ALERTSCRIPTS section in the man page gives details of the environment > > variables passed in with the the alert information. So, you could write a > > script to send snmp traps.I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote:After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at > > it again.I've grabbed a copy of xymon-4.4.0 svn and set it up on a test > > server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a > > drop-in replacement. Hopefully xymon can be made to do some specific things > > that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp > > trap on an alert. We have no need to receive snmp traps, only to send > > them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in > > pairs.each pair of bb servers monitors certain network segments, while > > only one of the pair is designated as the bbpager, i.e. only one of the pair > > sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split > > brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005.Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe
list Josh Luthman
I would send it here. This is pushed to people and stored by Henrik who couldn't be more tied to Xymon. Great begining and will last forever :)
▸
On 3/28/09, Martin Flemming <user-f286aaa49a76@xymon.invalid> wrote:Hi, Harald ! .. good question ... but it should not be a religious question .. :-) .. but i think, in both ways, you need a registration for the rights to append your notes ... So obvisously, it should the best way for all Xymon's to have one and only Wiki/Howto Side ... For Xymonton would be Galen the right person ....Or shall I send it directly to the listhmm, maybe the quickest solution ... thanks & cheers, martin On Fri, 27 Mar 2009, Husemann, Harald wrote:Hi Martin, I can of course write a doc about our setup to share my experiences. As I saw, there was a bit of a discussion about the right place for it, so, question to the list: Where shall I upload it? Or shall I send it directly to the list, and someone (TJ?) picks it + includes it? hh Martin Flemming schrieb:Hi, Harald !Xymon with Linux HA cluster with DRBDdid you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe
--
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
Those who don't understand UNIX are condemned to reinvent it, poorly.
--- Henry Spencer
list Joe Sloan
▸
Ralph Mitchell wrote:
Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps.
That's good info, it looks like I can hack something together given that information. The alerting failover issue sounds like a bit more of a challenge to get right. So, the bottom line is that, while xymon is clearly superior to bb on several counts, it's still not a drop-in replacement for bb, as there are some key pieces of functionality missing. Some of it looks to be fairly easy to fix - and maybe the fact that some assembly is required is actually a blessing in disguise - job security and all. If I come up with something useful I'll contribute it back. Joe
list T.J. Yang
knowledge in text format is the lowest common denominator. It keep you out of wiki dialects headache ;) tj
▸
Date: Sat, 28 Mar 2009 09:33:38 -0400 From: user-4c45a83f15cb@xymon.invalid To: user-ae9b8668bcde@xymon.invalid Subject: Re: [hobbit] xymon ready to replace bb? I would send it here. This is pushed to people and stored by Henrik who couldn't be more tied to Xymon. Great begining and will last forever :) On 3/28/09, Martin Flemming <user-f286aaa49a76@xymon.invalid> wrote:Hi, Harald ! .. good question ... but it should not be a religious question .. :-) .. but i think, in both ways, you need a registration for the rights to append your notes ... So obvisously, it should the best way for all Xymon's to have one and only Wiki/Howto Side ... For Xymonton would be Galen the right person ....Or shall I send it directly to the listhmm, maybe the quickest solution ... thanks & cheers, martin On Fri, 27 Mar 2009, Husemann, Harald wrote:Hi Martin, I can of course write a doc about our setup to share my experiences. As I saw, there was a bit of a discussion about the right place for it, so, question to the list: Where shall I upload it? Or shall I send it directly to the list, and someone (TJ?) picks it + includes it? hh Martin Flemming schrieb:Hi, Harald !Xymon with Linux HA cluster with DRBDdid you make some doku's or notes for it ? .. there is an old thread from Februar but unfortunatley no notes till this moment ... http://www.hswn.dk/hobbiton/2009/02/msg00146.html But there is already some place for it :-) http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide#Hobbit_in_HA HA-LAN using LinuxHA and DRBD [edit] If you have some notes, please contact T.J. Yang <user-8e841282cda5@xymon.invalid> to submit it to the wiki cheers, Martin Martin Flemming DESY / IT office : Building 2b / 008a Notkestr. 85 phone : XXX - XXXX - XXXX 22603 Hamburg mail : user-f286aaa49a76@xymon.invalid On Thu, 26 Mar 2009, Husemann, Harald wrote:Hi, for the failover part, what about using a real cluster like Linux HA cluster with DRBD? I've setup such a system a few weeks ago for us. hh Ralph Mitchell schrieb:Take a look at the Xymon alert man page: http://www.hswn.dk/hobbit/help/manpages/man5/hobbit-alerts.cfg.5.html You can specify a script to be executed for any given alert. The ALERT SCRIPTS section in the man page gives details of the environment variables passed in with the the alert information. So, you could write a script to send snmp traps. I don't know about alert failover. Ralph Mitchell On Wed, Mar 25, 2009 at 9:07 PM, J Sloan <user-b1d2c84d244b@xymon.invalid> wrote: After a bit of a hiatus from bb/hobbit/xymon issues, I'm looking at it again. I've grabbed a copy of xymon-4.4.0 svn and set it up on a test server here - very nice. As hope springs eternal, I'm again hoping to replace our aging big brother servers with xymon, since it's the closest thing to a drop-in replacement. Hopefully xymon can be made to do some specific things that bb does, which we depend on here, namely: 1. snmp traps - this is just a basic requirement to send out an snmp trap on an alert. We have no need to receive snmp traps, only to send them, as big brother does. We depend on that behavior to generate tickets by sending traps to netcool whenever there is a bb alert condition. 2. alerting failover - we have redundant bb servers are set up, in pairs. each pair of bb servers monitors certain network segments, while only one of the pair is designated as the bbpager, i.e. only one of the pair sends out alerts. But, should the passive bbpager be unable to reach the normally active bbpager, failover kicks in, and the normally passive server begins sending out all alerts. Worst case, we have a split brain condition and get 2 copies of an alert, but in practice, that's only happened a handful of times since 2005. Can xymon 4.4.0 do these things, or is there a way to implement this behavior with some appropriate add-ons? Joe-- Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX Those who don't understand UNIX are condemned to reinvent it, poorly. --- Henry Spencer
Quick access to Windows Live and your favorite MSN content with Internet Explorer 8. http://ie8.msn.com/microsoft/internet-explorer-8/en-us/ie8.aspx?ocid=B037MSN55C0701A
list Buchan Milne
▸
On Thursday 26 March 2009 15:40:16 Galen Johnson wrote:
While I don't want to minimize TJ's work, I don't believe people realize that Xymonton, the Xymon repository for custom tests, is actually built on top of Dokuwiki. This is exactly the type of information the tutorials page was meant to capture. It might be helpful if we had a one stop shop for all things Xymon instead of going one place for scripts and another for docs.
Hmm, well, Sourceforge now has hosted applications for projects, including mediawiki wiki's. If something is to be a one-stop-shop, I think sourceforge is currently in a better position to do this. However, I think a hobbitmon project admin is required to enable the mediawiki application. Other available hosted applications include: I've enabled mediawiki for Devmon, but haven't gotten around to putting any content there yet:
list Buchan Milne
▸
On Thursday 26 March 2009 15:40:16 Galen Johnson wrote:
While I don't want to minimize TJ's work, I don't believe people realize that Xymonton, the Xymon repository for custom tests, is actually built on top of Dokuwiki. This is exactly the type of information the tutorials page was meant to capture. It might be helpful if we had a one stop shop for all things Xymon instead of going one place for scripts and another for docs.
Hmm, well, Sourceforge now has hosted applications for projects, including mediawiki wiki's. If something is to be a one-stop-shop, I think sourceforge is currently in a better position to do this. However, I think a hobbitmon project admin is required to enable the mediawiki application. Other available hosted applications include:
Gallery LimeSurvey phpBB Wordpress (and many more) I've enabled mediawiki for Devmon, but haven't gotten around to putting any content there yet: http://apps.sourceforge.net/mediawiki/devmon/ Regards, Buchan
list Galen Johnson
Actually, someone has successfully managed to get a dokuwiki instance working under sourceforge. When I have time, I may play around with that. I just found a way to sync up without rsync. =G=
▸
-----Original Message-----
From: Buchan Milne [mailto:user-9b139aff4dec@xymon.invalid] Sent: Monday, March 30, 2009 6:49 AM
To: user-ae9b8668bcde@xymon.invalid
Cc: Galen Johnson
Subject: Re: [hobbit] xymon ready to replace bb?
On Thursday 26 March 2009 15:40:16 Galen Johnson wrote:While I don't want to minimize TJ's work, I don't believe people realize that Xymonton, the Xymon repository for custom tests, is actually built on top of Dokuwiki. This is exactly the type of information the tutorials page was meant to capture. It might be helpful if we had a one stop shop for all things Xymon instead of going one place for scripts and another for docs.
Hmm, well, Sourceforge now has hosted applications for projects, including mediawiki wiki's. If something is to be a one-stop-shop, I think sourceforge is currently in a better position to do this. However, I think a hobbitmon project admin is required to enable the mediawiki application. Other available hosted applications include: Gallery LimeSurvey phpBB Wordpress (and many more) I've enabled mediawiki for Devmon, but haven't gotten around to putting any content there yet: http://apps.sourceforge.net/mediawiki/devmon/ Regards, Buchan