alert on proc while both hosts running the same process at the same time
list Asif Iqbal
HOST=%host1|host2
PROC myproc ?? ??
How do I setup using PROC or may be some other method to alert when a process
myproc is running either on both server or on no server?
only one myproc is suppose to run on only one of the two hosts, host1 or host2
if myproc does not run on either of the hosts that should alert too.
so here is the condition
total number of myproc process on the hosts. each row is reprensenting a time
host1 host2
-------- --------
time1 0 0
time2 0 1
time3 1 0
time4 1 1
alert during time1 and time4
Is it possible to achieve this using stock hobbit? The other option
would be writing a server side script.
--
Asif Iqbal
PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu
A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?
list Japheth Cleaver
▸
-----Original Message-----
From: Asif Iqbal [mailto:user-6f4b51ac2a40@xymon.invalid]
Sent: Monday, July 12, 2010 4:33 PM
To: xymon at xymon.com
Subject: [xymon] alert on proc while both hosts running the same process at the same time
HOST=%host1|host2
PROC myproc ?? ??
How do I setup using PROC or may be some other method to alert when a process
myproc is running either on both server or on no server?
only one myproc is suppose to run on only one of the two hosts, host1 or host2
if myproc does not run on either of the hosts that should alert too.
so here is the condition
total number of myproc process on the hosts. each row is reprensenting a time
host1 host2
-------- --------
time1 0 0
time2 0 1
time3 1 0
time4 1 1
alert during time1 and time4
Is it possible to achieve this using stock hobbit? The other option
would be writing a server side script.
--
Asif Iqbal
You could try bbcombotest here, but you'd have to dedicate all of your proc monitoring status to this. And you'd want to disable alerting on the individual tests and then define a new bbcombotest to alert on.
A XOR would almost give you what you want, but it doesn't seem to be available according to bbcombotest.cfg in 4.3.0-beta2. You can do arithmetic on the Boolean values though, which makes it easy to ensure 1 and only 1 is green at once.
Overall.clustertest = (host1.proc + host2.proc) == 1
If you wanted this proc test to be only one of many procs you're testing on these hosts, you'll probably need to write something server-side for it. This is better for tests that don't have multiple things that can cause a status change.
HTH,
-jc
Side note: XOR and NOT support in bbcombotest would be awesome
list Patrick Nixon
Honestly, you can write a ext script in a few lines that will do this and you won't have to guess what's going on. clientlog will pull the procs section and you can grep it for the relevant process name and do your logic there.
▸
On Mon, Jul 12, 2010 at 8:01 PM, Cleaver, Japheth <user-2a1212dafc7b@xymon.invalid> wrote:-----Original Message----- From: Asif Iqbal [mailto:user-6f4b51ac2a40@xymon.invalid] Sent: Monday, July 12, 2010 4:33 PM To: xymon at xymon.com Subject: [xymon] alert on proc while both hosts running the same process at the same time HOST=%host1|host2 PROC myproc ?? ?? How do I setup using PROC or may be some other method to alert when a process myproc is running either on both server or on no server? only one myproc is suppose to run on only one of the two hosts, host1 or host2 if myproc does not run on either of the hosts that should alert too. so here is the condition total number of myproc process on the hosts. each row is reprensenting a time host1 host2 -------- -------- time1 0 0 time2 0 1 time3 1 0 time4 1 1 alert during time1 and time4 Is it possible to achieve this using stock hobbit? The other option would be writing a server side script. -- Asif IqbalYou could try bbcombotest here, but you'd have to dedicate all of your proc monitoring status to this. And you'd want to disable alerting on the individual tests and then define a new bbcombotest to alert on. A XOR would almost give you what you want, but it doesn't seem to be available according to bbcombotest.cfg in 4.3.0-beta2. You can do arithmetic on the Boolean values though, which makes it easy to ensure 1 and only 1 is green at once. Overall.clustertest = (host1.proc + host2.proc) == 1 If you wanted this proc test to be only one of many procs you're testing on these hosts, you'll probably need to write something server-side for it. This is better for tests that don't have multiple things that can cause a status change. HTH, -jc Side note: XOR and NOT support in bbcombotest would be awesome
list Vernon Everett
You can do it all server side.
Try something like this. (Pseudo-code - alter to taste)
COLOUR=red
RUNNINGON=""
PROCNAME=clusterprocess
RUNNING=1 #Assume it isn't running
for CLUSTERHOST in host1 host2 host3 # Add all cluster hosts here.
do
wget -o /dev/null
http://hobbit/hobbit-cgi/bb-hostsvc.sh\?HOST\=$CLUSTERHOST\&SERVICE\=proc
| grep $PROCNAME
CHECK=$?
((RUNNING=RUNNING*CHECK)) # If it's running anywhere
then $RUNNING=0
[ $CHECK -eq 0 ] && RUNNINGON="$CLUSTERHOST $RUNNINGON" # So we
know where it's running
done
[ $RUNNING -eq 0 ] && COLOUR=green
[ $(echo $RUNNINGON | wc -w) -gt 1 ] && COLOUR=yellow # Running on
more than one host. Might be an issue.
$BB $BBDISP "status $MACHINE.cluster $COLOUR $(date;echo;echo
$PROCNAME running on host $RUNNINGON"
Cheers
Vernon
▸
On Tue, Jul 13, 2010 at 9:14 AM, Patrick Nixon <user-1f2406f832af@xymon.invalid> wrote:Honestly, you can write a ext script in a few lines that will do this and you won't have to guess what's going on. clientlog will pull the procs section and you can grep it for the relevant process name and do your logic there. On Mon, Jul 12, 2010 at 8:01 PM, Cleaver, Japheth <user-2a1212dafc7b@xymon.invalid> wrote:-----Original Message----- From: Asif Iqbal [mailto:user-6f4b51ac2a40@xymon.invalid] Sent: Monday, July 12, 2010 4:33 PM To: xymon at xymon.com Subject: [xymon] alert on proc while both hosts running the same process at the same time HOST=%host1|host2 PROC myproc ?? ?? How do I setup using PROC or may be some other method to alert when a process myproc is running either on both server or on no server? only one myproc is suppose to run on only one of the two hosts, host1 or host2 if myproc does not run on either of the hosts that should alert too. so here is the condition total number of myproc process on the hosts. each row is reprensenting a time host1 host2 -------- -------- time1 0 0 time2 0 1 time3 1 0 time4 1 1 alert during time1 and time4 Is it possible to achieve this using stock hobbit? The other option would be writing a server side script. -- Asif IqbalYou could try bbcombotest here, but you'd have to dedicate all of your proc monitoring status to this. And you'd want to disable alerting on the individual tests and then define a new bbcombotest to alert on. A XOR would almost give you what you want, but it doesn't seem to be available according to bbcombotest.cfg in 4.3.0-beta2. You can do arithmetic on the Boolean values though, which makes it easy to ensure 1 and only 1 is green at once. Overall.clustertest = (host1.proc + host2.proc) == 1 If you wanted this proc test to be only one of many procs you're testing on these hosts, you'll probably need to write something server-side for it. This is better for tests that don't have multiple things that can cause a status change. HTH, -jc Side note: XOR and NOT support in bbcombotest would be awesome
list Henrik Størner
▸
In <user-23f12932eaa9@xymon.invalid> Asif Iqbal <user-6f4b51ac2a40@xymon.invalid> writes:
HOST=%host1|host2 PROC myproc ?? ??
How do I setup using PROC or may be some other method to alert when a process myproc is running either on both server or on no server?
With a combo-test. In bbcombotest.cfg you put host12.proc = (host1.proc + host2.proc) == 1 and then add a pseudo-host "host12" in bb-hosts for the combined status. 0.0.0.0 host12 # noconn "COMMENT:host1+2 process cluster" Regards, Henrik
list Asif Iqbal
▸
On Tue, Jul 13, 2010 at 6:54 AM, Henrik Størner <user-ce4a2c883f75@xymon.invalid> wrote:
In <user-23f12932eaa9@xymon.invalid> Asif Iqbal <user-6f4b51ac2a40@xymon.invalid> writes:HOST=%host1|host2 PROC myproc ?? ??How do I setup using PROC or may be some other method to alert when a process myproc is running either on both server or on no server?With a combo-test. In bbcombotest.cfg you put host12.proc = (host1.proc + host2.proc) == 1 and then add a pseudo-host "host12" in bb-hosts for the combined status. 0.0.0.0 host12 # noconn "COMMENT:host1+2 process cluster"
thanks to all of you for the server side ext suggestion. that was one of the option I mentioned in my email. I guess that means can't do it with stock hobbit. I will need to create a separate service column for just that one process. no problem. thanks again
Regards, Henrik
▸
-- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing?
list Vernon Everett
Henrik's solution with combo tests is the easiest, but might give false positives if you are monitoring other procs as well as the cluster processes. Mine is a little more complex, but will not be effected by other proc alerts. My advice? Keep it as simple as you can get away with. Use Henrik's method if you can. Regards
▸
Vernon
On Tue, Jul 13, 2010 at 8:56 PM, Asif Iqbal <user-6f4b51ac2a40@xymon.invalid> wrote:On Tue, Jul 13, 2010 at 6:54 AM, Henrik Størner <user-ce4a2c883f75@xymon.invalid> wrote:In <user-23f12932eaa9@xymon.invalid> Asif Iqbal <user-6f4b51ac2a40@xymon.invalid> writes:HOST=%host1|host2 PROC myproc ?? ??How do I setup using PROC or may be some other method to alert when a process myproc is running either on both server or on no server?With a combo-test. In bbcombotest.cfg you put host12.proc = (host1.proc + host2.proc) == 1 and then add a pseudo-host "host12" in bb-hosts for the combined status. 0.0.0.0 host12 # noconn "COMMENT:host1+2 process cluster"thanks to all of you for the server side ext suggestion. that was one of the option I mentioned in my email. I guess that means can't do it with stock hobbit. I will need to create a separate service column for just that one process. no problem. thanks againRegards, Henrik-- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing?
list Asif Iqbal
On Tue, Jul 13, 2010 at 7:12 PM, Vernon Everett
▸
<user-b3f8dacb72c8@xymon.invalid> wrote:Henrik's solution with combo tests is the easiest, but might give false positives if you are monitoring other procs as well as the cluster processes. Mine is a little more complex, but will not be effected by other proc alerts. My advice? Keep it as simple as you can get away with. Use Henrik's method if you can.
well I think, Henrik meant a separate service column for just that proc, not the proc service column. I am aware of bbcombohost and that is what I was referring when I side server side ext in OP. But did not want pollute any other idea by mentioning it ahead of time. and it worked :-) . I like your one as it gives some cool ideas on how to monitor stuff. I will save it in cool xymon tricks depot. All ideas, that have been presented here so far, require a separate service column for my specific proc, lets call it clusterproc. So based on that, I will go with bbcombotest just because it is simpler and I am using it for other tasks within xymon
▸
Regards Vernon On Tue, Jul 13, 2010 at 8:56 PM, Asif Iqbal <user-6f4b51ac2a40@xymon.invalid> wrote:On Tue, Jul 13, 2010 at 6:54 AM, Henrik Størner <user-ce4a2c883f75@xymon.invalid> wrote:In <user-23f12932eaa9@xymon.invalid> Asif Iqbal <user-6f4b51ac2a40@xymon.invalid> writes:HOST=%host1|host2 PROC myproc ?? ??How do I setup using PROC or may be some other method to alert when a process myproc is running either on both server or on no server?With a combo-test. In bbcombotest.cfg you put host12.proc = (host1.proc + host2.proc) == 1 and then add a pseudo-host "host12" in bb-hosts for the combined status. 0.0.0.0 host12 # noconn "COMMENT:host1+2 process cluster"thanks to all of you for the server side ext suggestion. that was one of the option I mentioned in my email. I guess that means can't do it with stock hobbit. I will need to create a separate service column for just that one process. no problem. thanks againRegards, Henrik-- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing?
-- Asif Iqbal PGP Key: 0xE62693C5 KeyServer: pgp.mit.edu A: Because it messes up the order in which people normally read text. Q: Why is top-posting such a bad thing?
list Kenneth Falor
Greetings, I need so assistance in setting up "conditional" or "dependent" alert status on hobbit, so for example, if the firewall dies, it knows that devices X, Y and Z are "dependent" on the firewall, therefore it won't tell us about 55 things that are down, just tell us the firewall is down? This is a major pain in the rump every time we lose a VPN tunnel and we all get 100 text messages. Kenneth
list Josh Luthman
Is it all conn tests? Use route if so.
▸
On 7/16/10, Kenneth Falor <user-b203be41ccd1@xymon.invalid> wrote:Greetings, I need so assistance in setting up "conditional" or "dependent" alert status on hobbit, so for example, if the firewall dies, it knows that devices X, Y and Z are "dependent" on the firewall, therefore it won't tell us about 55 things that are down, just tell us the firewall is down? This is a major pain in the rump every time we lose a VPN tunnel and we all get 100 text messages. Kenneth
--
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
list Kenneth Falor
Yes they are conn tests. I looked in the docs and the demo site at http://www.xymon.com/ but could not find any examples of how to use 'route' beyond what is halfway down http://www.xymon.com/hobbit/help/manpages/man5/bb-hosts.5.html Part of my bb-hosts page looks like this: group-compress Plan ER 10.1.64.99 PLANPRT # ping 10.1.64.254 TXPLA2401er.fw.int # ping 24.15.8.130 TXPLA2401er.fw.ext # ping 24.15.8.129 TXPLA2401er.gateway # ping 24.15.8.249 TXPLA2401er.serial # ping 24.15.8.250 TXPLA2401er.Grande.serial # ping 10.1.64.12 PlanER.power # ping 16.155.240.142 PlanER.cellbackup # !conn So if I did not want multiple alerts for the failure of any part of the WAN would I add a new rule to bb-hosts page like: Route:TXPLA2401er.fw.int,TXPLA2401er.fw.ext,TXPLA2401er.gateway,TXPLA2401er.serial,TXPLA2401er.Grande.serial Anyone have an example of how to use route that they can share? Kenneth
▸
-----Original Message-----
From: Josh Luthman [mailto:user-4c45a83f15cb@xymon.invalid]
Sent: Friday, July 16, 2010 11:56 AM
To: xymon at xymon.com
Subject: Re: [xymon] conditional or dependent alerts
Is it all conn tests? Use route if so.
On 7/16/10, Kenneth Falor <user-b203be41ccd1@xymon.invalid> wrote:Greetings, I need so assistance in setting up "conditional" or "dependent" alert status on hobbit, so for example, if the firewall dies, it knows that devices X, Y and Z are "dependent" on the firewall, therefore it won't tell us about 55 things that are down, just tell us the firewall is down? This is a major pain in the rump every time we lose a VPN tunnel and we all get 100 text messages. Kenneth
-- Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX
list Kenneth Falor
Never mind...I found an old post I will work with. Kenneth
▸
-----Original Message----- From: Kenneth Falor [mailto:user-b203be41ccd1@xymon.invalid] Sent: Friday, July 16, 2010 3:36 PM To: xymon at xymon.com Subject: RE: [xymon] conditional or dependent alerts Yes they are conn tests. I looked in the docs and the demo site at http://www.xymon.com/ but could not find any examples of how to use 'route' beyond what is halfway down http://www.xymon.com/hobbit/help/manpages/man5/bb-hosts.5.html Part of my bb-hosts page looks like this: group-compress Plan ER 10.1.64.99 PLANPRT # ping 10.1.64.254 TXPLA2401er.fw.int # ping 24.15.8.130 TXPLA2401er.fw.ext # ping 24.15.8.129 TXPLA2401er.gateway # ping 24.15.8.249 TXPLA2401er.serial # ping 24.15.8.250 TXPLA2401er.Grande.serial # ping 10.1.64.12 PlanER.power # ping 16.155.240.142 PlanER.cellbackup # !conn So if I did not want multiple alerts for the failure of any part of the WAN would I add a new rule to bb-hosts page like: Route:TXPLA2401er.fw.int,TXPLA2401er.fw.ext,TXPLA2401er.gateway,TXPLA2401er.serial,TXPLA2401er.Grande.serial Anyone have an example of how to use route that they can share? Kenneth -----Original Message----- From: Josh Luthman [mailto:user-4c45a83f15cb@xymon.invalid] Sent: Friday, July 16, 2010 11:56 AM To: xymon at xymon.com Subject: Re: [xymon] conditional or dependent alerts Is it all conn tests? Use route if so. On 7/16/10, Kenneth Falor <user-b203be41ccd1@xymon.invalid> wrote:
Greetings, I need so assistance in setting up "conditional" or "dependent" alert status on hobbit, so for example, if the firewall dies, it knows that devices X, Y and Z are "dependent" on the firewall, therefore it won't tell us about 55 things that are down, just tell us the firewall is down? This is a major pain in the rump every time we lose a VPN tunnel and we all get 100 text messages. Kenneth
-- Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX