hobbit-clients configuration not taking
list Josh Luthman
HOST=one.myhost.com
LOAD 20 40
HOST=two.myhost.com
LOG /var/log/messages e100_watchdog COLOR=red
HOST=three.myhost.com
PROC cron 1 -1 red
PROC apache2 1 -1 red
PROC ntpd 1 -1 red
DEFAULT
# These are the built-in defaults.
UP 1h
LOAD 5.0 10.0
DISK * 90 95
MEMPHYS 100 101
MEMSWAP 50 80
MEMACT 90 97
Neither of the first three HOST are taking effect. I'm looking at the
bb.html page and seeing PROC (for three) stating "clear No process checks
defined" and similar with one and two.
However on an bbc 1.9i btf (better then free) client it is pushing PROCs to
the server:
#cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg:
...
PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING
PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING
export PROCS PAGEPROC
...
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
list Greg Hubbard
Hmm.. Well, since you are pretty experienced you have probably checked the obvious places. I would check to make sure that the Xymon server knows these hosts by these names, and not by a shorter version (without the domain name). And you know that the hobbit-clients.cfg bits are exclusive to Xymon and will not work with Big Brother clients -- Big Brother does not know how to send the necessary data to Xymon for interpretation. You have to use Xymon clients for this (which leaves you stuck with Windows machines unless the BBWin client supports this now). GLH
▸
On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:
HOST=one.myhost.com
LOAD 20 40
HOST=two.myhost.com
LOG /var/log/messages e100_watchdog COLOR=red
HOST=three.myhost.com
PROC cron 1 -1 red
PROC apache2 1 -1 red
PROC ntpd 1 -1 red
DEFAULT
# These are the built-in defaults.
UP 1h
LOAD 5.0 10.0
DISK * 90 95
MEMPHYS 100 101
MEMSWAP 50 80
MEMACT 90 97
Neither of the first three HOST are taking effect. I'm looking at the
bb.html page and seeing PROC (for three) stating "clear No process checks
defined" and similar with one and two.
However on an bbc 1.9i btf (better then free) client it is pushing PROCs to
the server:
#cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg:
...
PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING
PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING
export PROCS PAGEPROC
...
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
--
Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my
advice is worth at least as much as what you are paying for it, or your
money cheerfully refunded.
list Josh Luthman
▸
Hmm.. Well, since you are pretty experienced you have probably checked the obvious places. I would check to make sure that the Xymon server knows these hosts by these names, and not by a shorter version (without the domain name).
As far as I know the only place to look is hobbit-clients.cfg. In hobbit-alerts.cfg this rule works: HOST=%.*\.imaginenetworksllc\.com The URL has the FQDN, so I can only imagine the same is expected of hobbit-clients.cfg: http://myserverhere.com/hobbit-cgi/bb-hostsvc.sh?HOST=two.imaginenetworksllc.com&SERVICE=msgs
▸
And you know that the hobbit-clients.cfg bits are exclusive to Xymon and will not work with Big Brother clients -- Big Brother does not know how to send the necessary data to Xymon for interpretation. You have to use Xymon clients for this (which leaves you stuck with Windows machines unless the
BBWin client supports this now).
All other clients are hobbit-4.2.0 just like the server. No patches, just
4.2.0 release.
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
On Wed, Sep 9, 2009 at 3:01 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid> wrote:
Hmm.. Well, since you are pretty experienced you have probably checked the obvious places. I would check to make sure that the Xymon server knows these hosts by these names, and not by a shorter version (without the domain name). And you know that the hobbit-clients.cfg bits are exclusive to Xymon and will not work with Big Brother clients -- Big Brother does not know how to send the necessary data to Xymon for interpretation. You have to use Xymon clients for this (which leaves you stuck with Windows machines unless the BBWin client supports this now). GLH On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:HOST=one.myhost.com LOAD 20 40 HOST=two.myhost.com LOG /var/log/messages e100_watchdog COLOR=red HOST=three.myhost.com PROC cron 1 -1 red PROC apache2 1 -1 red PROC ntpd 1 -1 red DEFAULT # These are the built-in defaults. UP 1h LOAD 5.0 10.0 DISK * 90 95 MEMPHYS 100 101 MEMSWAP 50 80 MEMACT 90 97 Neither of the first three HOST are taking effect. I'm looking at the bb.html page and seeing PROC (for three) stating "clear No process checks defined" and similar with one and two. However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC ... Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
list Greg Hubbard
Then what was this all about? I guess I read it wrong.
▸
*"However on an bbc 1.9i btf (better then free) client it is pushing PROCs
to the server:
#cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg:
...
PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING
PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING
export PROCS PAGEPROC"• What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section.
list Josh Luthman
Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear. two.myhost.com does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com and three.myhost.com has no data on the server. hobbitclient.log is full of: 2009-09-09 14:38:44 Failed to get a message, terminating $bb server.fqdn.com ping #this command works hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log?
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid> wrote:
Then what was this all about? I guess I read it wrong. *"However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" • What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the
http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3Cxymon-server%3E/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>;
▸
link. On Solaris you would look for a [ps] header, then a list of
processes. This will show you that the data is getting pumped over. (For
Linux, etc. there might be something different).
And, if your config fragment is correct, you would not expect any PROC
checks for one or two, just for three, since you only defined them for three
and there are no PROC checks in the DEFAULT section.
list Greg Hubbard
Good. So if you tried PROC on "two" you should get something. Something is deeply wrong on the other two hosts. And Xymon likes to silently ignore errors. My **guess** is that something crummy has happened to the failing clients. Since there is not much to them they should be easy enough to check out. Might be a good education. Did you install from RPM, or compile your own copy of the client? Are you able to reinstall the client piece from a known working source? Are you using the "client update" piece where the client can fetch a tarball from the server and install it on its own?
▸
GLH
On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear. two.myhost.com does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com and three.myhost.com has no data on the server. hobbitclient.log is full of: 2009-09-09 14:38:44 Failed to get a message, terminating $bb server.fqdn.com ping #this command works hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Then what was this all about? I guess I read it wrong. *"However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" • What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3cxymon-server%3e/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section.
-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
list Josh Luthman
Confirmed - PROCS works on the host in which the server is getting client data from. I compiled on each client individually (see the last link of my last post). Exact same commands on each - literally copy/paste short of root passwords. I will recompile the two failing clients tonight to see what happens. I wasn't aware of any client update. Assuming this is not default, but still, is there a man page detailing this?
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
On Wed, Sep 9, 2009 at 4:07 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid> wrote:
Good. So if you tried PROC on "two" you should get something. Something is deeply wrong on the other two hosts. And Xymon likes to silently ignore errors. My **guess** is that something crummy has happened to the failing clients. Since there is not much to them they should be easy enough to check out. Might be a good education. Did you install from RPM, or compile your own copy of the client? Are you able to reinstall the client piece from a known working source? Are you using the "client update" piece where the client can fetch a tarball from the server and install it on its own? GLH On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear. two.myhost.com does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com and three.myhost.com has no data on the server. hobbitclient.log is full of: 2009-09-09 14:38:44 Failed to get a message, terminating $bb server.fqdn.com ping #this command works hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Then what was this all about? I guess I read it wrong. *"However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" • What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3cxymon-server%3e/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section.-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
list Josh Luthman
Forgot to mention this, sorry for the double post everyone!
The really weird part is that the clear test has data (and it is current
enough to include the latest httpd PIDs, my recent ssh login and shell)...
Wed Sep 09 16:21:44 2009
Wed Sep 9 16:21:38 EDT 2009 - Processes NOT ok
clear No process checks defined
PID PPID USER STARTED S PRI %CPU TIME %MEM RSZ VSZ CMD
1 0 root May 29 S 24 0.0 00:25:23 0.0 652 2036 init
[3]
2 1 root May 29 S 139 0.0 00:00:11 0.0 0 0
[migration/0]
3 1 root May 29 S 5 0.0 00:00:00 0.0 0 0
[ksoftirqd/0]
4 1 root May 29 S 139 0.0 00:00:00 0.0 0 0
[watchdog/0]
5 1 root May 29 S 139 0.0 00:00:11 0.0 0 0
[migration/1]
6 1 root May 29 S 4 0.0 00:00:00 0.0 0 0
[ksoftirqd/1]
7 1 root May 29 S 139 0.0 00:00:00 0.0 0 0
[watchdog/1]
8 1 root May 29 S 29 0.0 00:00:00 0.0 0 0
[events/0]
9 1 root May 29 S 29 0.0 00:00:00 0.0 0 0
[events/1]
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
On Wed, Sep 9, 2009 at 4:23 PM, Josh Luthman <user-4c45a83f15cb@xymon.invalid>wrote:
Confirmed - PROCS works on the host in which the server is getting client data from. I compiled on each client individually (see the last link of my last post). Exact same commands on each - literally copy/paste short of root passwords. I will recompile the two failing clients tonight to see what happens. I wasn't aware of any client update. Assuming this is not default, but still, is there a man page detailing this? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 4:07 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid> wrote:Good. So if you tried PROC on "two" you should get something. Something is deeply wrong on the other two hosts. And Xymon likes to silently ignore errors. My **guess** is that something crummy has happened to the failing clients. Since there is not much to them they should be easy enough to check out. Might be a good education. Did you install from RPM, or compile your own copy of the client? Are you able to reinstall the client piece from a known working source? Are you using the "client update" piece where the client can fetch a tarball from the server and install it on its own? GLH On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear. two.myhost.com does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com and three.myhost.com has no data on the server. hobbitclient.log is full of: 2009-09-09 14:38:44 Failed to get a message, terminating $bb server.fqdn.com ping #this command works hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Then what was this all about? I guess I read it wrong. *"However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" • What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3cxymon-server%3e/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section.-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
list Greg Hubbard
re: client update -- it is a murky subject. It is documented somewhere, but I forget where. what you do is tar up your client directory and compress it, and then put it somewhere. then you can refer to it in the client-local.cfg file. When the client checks in it will check to see if there is a new version. If so, it downloads it and installs it (by unpacking the tar ball). This works for Solaris, but does not work for AIX. I would use it carefully. This also means that you have to deal with each host individually in your client-local file, but this is not a bad thing unless you have thousands of them. GLH
▸
From: Josh Luthman [mailto:user-4c45a83f15cb@xymon.invalid]
Sent: Wednesday, September 09, 2009 3:24 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] hobbit-clients configuration not taking
Confirmed - PROCS works on the host in which the server is getting client data from.
I compiled on each client individually (see the last link of my last post). Exact same commands on each - literally copy/paste short of root passwords. I will recompile the two failing clients tonight to see what happens.
I wasn't aware of any client update. Assuming this is not default, but still, is there a man page detailing this?
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however improbable, must be the truth."
--- Sir Arthur Conan Doyle
On Wed, Sep 9, 2009 at 4:07 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid<mailto:user-435e16ecfd6a@xymon.invalid>> wrote:
Good. So if you tried PROC on "two" you should get something. Something is deeply wrong on the other two hosts. And Xymon likes to silently ignore errors.
My **guess** is that something crummy has happened to the failing clients. Since there is not much to them they should be easy enough to check out. Might be a good education.
Did you install from RPM, or compile your own copy of the client? Are you able to reinstall the client piece from a known working source? Are you using the "client update" piece where the client can fetch a tarball from the server and install it on its own?
GLH
On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid<mailto:user-4c45a83f15cb@xymon.invalid>> wrote:
Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear.
two.myhost.com<http://two.myhost.com/>; does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com<http://one.myhost.com/>; and three.myhost.com<http://three.myhost.com/>; has no data on the server.
▸
hobbitclient.log is full of:
2009-09-09 14:38:44 Failed to get a message, terminating
$bb server.fqdn.com<http://server.fqdn.com/>; ping #this command works
▸
hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid<mailto:user-435e16ecfd6a@xymon.invalid>> wrote: Then what was this all about? I guess I read it wrong. "However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3cxymon-server%3e/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section. -- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
list Greg Hubbard
One other note -- can you recompile on each client system? One wonders if there are some issues with dynamically linked libraries that might be causing something that compiles okay on machine A to blow up on machine B. This is something that the RPM, apt, yum, et al might prevent (if the packages are maintained well), but you might get hosed if you are like me and just scp a directory to a new client and then fire it up.
▸
GLH
On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Confirmed - PROCS works on the host in which the server is getting client data from. I compiled on each client individually (see the last link of my last post). Exact same commands on each - literally copy/paste short of root passwords. I will recompile the two failing clients tonight to see what happens. I wasn't aware of any client update. Assuming this is not default, but still, is there a man page detailing this? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 4:07 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Good. So if you tried PROC on "two" you should get something. Something is deeply wrong on the other two hosts. And Xymon likes to silently ignore errors. My **guess** is that something crummy has happened to the failing clients. Since there is not much to them they should be easy enough to check out. Might be a good education. Did you install from RPM, or compile your own copy of the client? Are you able to reinstall the client piece from a known working source? Are you using the "client update" piece where the client can fetch a tarball from the server and install it on its own? GLH On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear. two.myhost.com does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com and three.myhost.com has no data on the server. hobbitclient.log is full of: 2009-09-09 14:38:44 Failed to get a message, terminating $bb server.fqdn.com ping #this command works hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Then what was this all about? I guess I read it wrong. *"However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" • What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3cxymon-server%3e/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section.-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.
list Josh Luthman
yum -y update gcc gcc-c++ pcre-devel libpng-devel openssl-devel openldap-devel fping rrdtool-devel ntp Doing this fixed one. Wasn't needed on three. Both of these two clients are updating the full client data now. Thank you very much for your help Greg!
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
"When you have eliminated the impossible, that which remains, however
improbable, must be the truth."
--- Sir Arthur Conan Doyle
On Wed, Sep 9, 2009 at 4:35 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid> wrote:
One other note -- can you recompile on each client system? One wonders if there are some issues with dynamically linked libraries that might be causing something that compiles okay on machine A to blow up on machine B. This is something that the RPM, apt, yum, et al might prevent (if the packages are maintained well), but you might get hosed if you are like me and just scp a directory to a new client and then fire it up. GLH On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Confirmed - PROCS works on the host in which the server is getting client data from. I compiled on each client individually (see the last link of my last post). Exact same commands on each - literally copy/paste short of root passwords. I will recompile the two failing clients tonight to see what happens. I wasn't aware of any client update. Assuming this is not default, but still, is there a man page detailing this? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 4:07 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Good. So if you tried PROC on "two" you should get something. Something is deeply wrong on the other two hosts. And Xymon likes to silently ignore errors. My **guess** is that something crummy has happened to the failing clients. Since there is not much to them they should be easy enough to check out. Might be a good education. Did you install from RPM, or compile your own copy of the client? Are you able to reinstall the client piece from a known working source? Are you using the "client update" piece where the client can fetch a tarball from the server and install it on its own? GLH On 9/9/09, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Suggesting that the bbc is capable of labeling tests. The hobbit-clients' data is staying clear. two.myhost.com does have data and it is [ps] and [msgs:/var/log/messages] one.myhost.com and three.myhost.com has no data on the server. hobbitclient.log is full of: 2009-09-09 14:38:44 Failed to get a message, terminating $bb server.fqdn.com ping #this command works hobbit-4.2.0 This is running a CentOS release 5.2 (Final) and CentOS release 5 (Final) respectively - "Red Hat Linux". One thread on the archives was able to fix it by installing the Debian package. Obviously I can't do that. The strange part is I executed the exact same commands across all three - the same ones I put up here http://en.wikibooks.org/wiki/System_Monitoring_with_Xymon/Administration_Guide/Compiling_on_CentOS Perhaps there is a package missing of some sort? Is there a way to get more detailed logs from the hobbitclient.log? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX "When you have eliminated the impossible, that which remains, however improbable, must be the truth." --- Sir Arthur Conan Doyle On Wed, Sep 9, 2009 at 3:34 PM, Greg Hubbard <user-435e16ecfd6a@xymon.invalid>wrote:Then what was this all about? I guess I read it wrong. *"However on an bbc 1.9i btf (better then free) client it is pushing PROCs to the server: #cat ~bbuser/bbc1.9i-btf/etc/bbwarnsetup.cfg: ... PROCS="bbrun" # (YELLOW) WARN IF NOT RUNNING PAGEPROC="cron" # (RED) PAGE IF NOT RUNNING export PROCS PAGEPROC" • What you might want to do is track down the "raw data" being sent by these hosts to see if they contain a PROC secion. I think you can get to it on each host through the http://<xymon-server>/hobbit-cgi/bb-hostsvc.sh?CLIENT=<client<http://%3cxymon-server%3e/hobbit-cgi/bb-hostsvc.sh?CLIENT=%3Cclient>>; link. On Solaris you would look for a [ps] header, then a list of processes. This will show you that the data is getting pumped over. (For Linux, etc. there might be something different). And, if your config fragment is correct, you would not expect any PROC checks for one or two, just for three, since you only defined them for three and there are no PROC checks in the DEFAULT section.-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.-- Disclaimer: 1) all opinions are my own, 2) I may be completely wrong, 3) my advice is worth at least as much as what you are paying for it, or your money cheerfully refunded.