Plagued by purple
list David Mills
All -
Am fairly new to Xymon and apologize if this is documented somewhere and I missed it.
I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as "purple", the other half as green. As far as I can tell, everything's running just fine. It seems to be a simple data refresh problem of some sort, but haven't been able prove my hunch.
The problem started after a reboot of the server. Everything came up OK, except for the following list of "missing" tests:
Purple Tests:
iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones
Green Tests:
bbd conn cpu disk http info memory msgs ntp ports procs ssh trends
I've restarted the server: ("$xymon_home/xymon.sh restart") and tried to find something in the logs, but am not making ground on this fast enough.
Help?
Thanks!
david
~~~~~~~~~~~~~~~~~~~
David Mills
Systems Administrator
Northrop Grumman
XXX-XXX-XXXX
user-eb64c112f0e9@xymon.invalid
list Josh Luthman
Either the server isn't gathering it or the clients aren't sending the data. The raid script that I have is sent by the client.
▸
On Oct 16, 2012 2:08 AM, "Mills, David (IS)" <user-eb64c112f0e9@xymon.invalid> wrote:
All – Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as “purple”, the other half as green. As far as I can tell, everything’s running just fine. It seems to be a simple data refresh problem of some sort, but haven’t been able prove my hunch. The problem started after a reboot of the server. Everything came up OK, except for the following list of “missing” tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I’ve restarted the server: (“$xymon_home/xymon.sh restart”) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david ~~~~~~~~~~~~~~~~~~~ *David Mills* Systems Administrator *Northrop Grumman* XXX-XXX-XXXX user-eb64c112f0e9@xymon.invalid
list David Mills
Josh Luthman user-4c45a83f15cb@xymon.invalid <mailto:xymon%40xymon.com?Subject=Re%3A%20%5BXymon%5D%20Plagued%20by%20purple&In-Reply-To=user-227d6358e221@xymon.invalid%3E>
▸
Either the server isn't gathering it or the clients aren't sending the data.
The raid script that I have is sent by the client.Thanks, Josh, but can you point out where I can check to see which of those options is my likely culprit? Also, don't quite follow your comment about your "raid script". What raid script? Sorry! David
▸
On Oct 16, 2012 2:08 AM, "Mills, David (IS)" <user-eb64c112f0e9@xymon.invalid> wrote:All . Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as .purple., the other half as green. As far as I can tell, everything.s running just fine. It seems to be a simple data refresh problem of some sort, but haven.t been able prove my hunch. The problem started after a reboot of the server. Everything came up OK, except for the following list of .missing. tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I.ve restarted the server: (.$xymon_home/xymon.sh restart.) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david
~~~~~~~~~~~~~~~~~~~ David Mills Systems Administrator Northrop Grumman XXX-XXX-XXXX user-eb64c112f0e9@xymon.invalid
list Benjamin P. August
It looks like the green tests are all standard Xymon tests and the purple ones might be external scripts in client/ext/ in the Xymon (or Hobbit) home directory. Check the client/etc/clientlaunch.cfg on any of the purple-plagued clients and see if any of the purple tests are mentioned. ----- Original Message ----- From: "David Mills (IS)" <user-eb64c112f0e9@xymon.invalid> To: xymon at xymon.com Sent: Tuesday, October 16, 2012 9:48:46 AM Subject: Re: [Xymon] Plagued by purple
Josh Luthman user-4c45a83f15cb@xymon.invalid
▸
Either the server isn't gathering it or the clients aren't sending the data.
The raid script that I have is sent by the client. Thanks, Josh, but can you point out where I can check to see which of those options is my likely culprit? Also, don’t quite follow your comment about your “raid script”. What raid script? Sorry! David
On Oct 16, 2012 2:08 AM, "Mills, David (IS)" <user-eb64c112f0e9@xymon.invalid> wrote:All . Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as .purple., the other half as green. As far as I can tell, everything.s running just fine. It seems to be a simple data refresh problem of some sort, but haven.t been able prove my hunch. The problem started after a reboot of the server. Everything came up OK, except for the following list of .missing. tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I.ve restarted the server: (.$xymon_home/xymon.sh restart.) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david
~~~~~~~~~~~~~~~~~~~ David Mills Systems Administrator Northrop Grumman XXX-XXX-XXXX user-eb64c112f0e9@xymon.invalid
list Josh Luthman
Can you provide a screenshot of your bb.html (front page)? You have a raid column that is going purple. The "raid script" I use to make the raid column was taken from Deadcat ages ago. Assuming you have the same script, the data is collected on the client and I believe the status is processed on the server. Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Tue, Oct 16, 2012 at 12:48 PM, Mills, David (IS) <user-eb64c112f0e9@xymon.invalid>wrote:
*Josh Luthman* *user-4c45a83f15cb@xymon.invalid *<xymon%40xymon.com?Subject=Re%3A%20%5BXymon%5D%20Plagued%20by%20purple&In-Reply-To=user-227d6358e221@xymon.invalid%3E>
▸
Either the server isn't gathering it or the clients aren't sending the data. The raid script that I have is sent by the client.Thanks, Josh, but can you point out where I can check to see which of those options is my likely culprit? Also, don’t quite follow your comment about your “raid script”. What raid script? Sorry! DavidOn Oct 16, 2012 2:08 AM, "Mills, David (IS)" <user-eb64c112f0e9@xymon.invalid> wrote:All . Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as .purple., the other half as green. As far as I can tell, everything.s running just fine. It seems to be a simple data refresh problem of some sort, but haven.t been able prove my hunch. The problem started after a reboot of the server. Everything came upOK,except for the following list of .missing. tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I.ve restarted the server: (.$xymon_home/xymon.sh restart.) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david~~~~~~~~~~~~~~~~~~~ *David Mills* Systems Administrator *Northrop Grumman* XXX-XXX-XXXX user-eb64c112f0e9@xymon.invalid
list James Wade
I was one of the original installers of this installation. In this case, we modified scripts and ran the client separately from $XYMONHOME/client Start the client by changing to the $XYMONHOME/client directory and running, runclient.sh start That should resolve your issue. James On Tue, Oct 16, 2012 at 11:53 AM, Benjamin P. August
▸
<user-e992dd5eb2a5@xymon.invalid>wrote:
It looks like the green tests are all standard Xymon tests and the purple ones might be external scripts in client/ext/ in the Xymon (or Hobbit) home directory. Check the client/etc/clientlaunch.cfg on any of the purple-plagued clients and see if any of the purple tests are mentioned. *From: *"David Mills (IS)" <user-eb64c112f0e9@xymon.invalid> *To: *xymon at xymon.com *Sent: *Tuesday, October 16, 2012 9:48:46 AM *Subject: *Re: [Xymon] Plagued by purple*Josh Luthman* *user-4c45a83f15cb@xymon.invalid *<xymon%40xymon.com?Subject=Re%3A%20%5BXymon%5D%20Plagued%20by%20purple&In-Reply-To=user-227d6358e221@xymon.invalid%3E> Either the server isn't gathering it or the clients aren't sending the data. The raid script that I have is sent by the client.Thanks, Josh, but can you point out where I can check to see which of those options is my likely culprit? Also, don’t quite follow your comment about your “raid script”. What raid script? Sorry! DavidOn Oct 16, 2012 2:08 AM, "Mills, David (IS)" <user-eb64c112f0e9@xymon.invalid> wrote:All . Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as .purple., the other half as green. As far as I can tell, everything.s running just fine. It seems to be a simple data refresh problem of some sort, but haven.t been able prove my hunch. The problem started after a reboot of the server. Everything came upOK,except for the following list of .missing. tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I.ve restarted the server: (.$xymon_home/xymon.sh restart.) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david~~~~~~~~~~~~~~~~~~~ *David Mills* Systems Administrator *Northrop Grumman* XXX-XXX-XXXX user-eb64c112f0e9@xymon.invalid
list Ryan Novosielski
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 How about that -- historical knowledge from a mailing list!
▸
On 10/16/2012 01:43 PM, James Wade wrote:I was one of the original installers of this installation. In this case, we modified scripts and ran the client separately from $XYMONHOME/client Start the client by changing to the $XYMONHOME/client directory and running, runclient.sh start That should resolve your issue. James On Tue, Oct 16, 2012 at 11:53 AM, Benjamin P. August <user-e992dd5eb2a5@xymon.invalid <mailto:user-e992dd5eb2a5@xymon.invalid>> wrote: It looks like the green tests are all standard Xymon tests and the purple ones might be external scripts in client/ext/ in the Xymon (or Hobbit) home directory. Check the client/etc/clientlaunch.cfg on any of the purple-plagued clients and see if any of the purple tests are mentioned.
*From: *"David Mills (IS)" <user-eb64c112f0e9@xymon.invalid
<mailto:user-eb64c112f0e9@xymon.invalid>> *To: *xymon at xymon.com <mailto:xymon at xymon.com> *Sent: *Tuesday, October 16, 2012 9:48:46 AM *Subject: *Re: [Xymon] Plagued by purple*Josh Luthman* user-107cd28343dd@xymon.invalid _
▸
Either the server isn't gathering it or the clients aren't sending the data. The raid script that I have is sent by the client.Thanks, Josh, but can you point out where I can check to see which of those options is my likely culprit? Also, don’t quite follow your comment about your “raid script”. What raid script? Sorry! David
On Oct 16, 2012 2:08 AM, "Mills, David (IS)" <David.Mills at
▸
ngc.com <http://ngc.com>>; wrote:All . Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as .purple., the other half as green. As far as I can tell, everything.s running just fine. It seems to be a simple data refresh problem of some sort, but haven.t been able prove my hunch. The problem started after a reboot of the server. Everything came up OK, except for the following list of .missing. tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I.ve restarted the server: (.$xymon_home/xymon.sh restart.) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david~~~~~~~~~~~~~~~~~~~ *David Mills* Systems Administrator */Northrop
Grumman/* XXX-XXX-XXXX <tel:XXX-XXX-XXXX> user-eb64c112f0e9@xymon.invalid
- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/EI-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iEYEARECAAYFAlB9nroACgkQmb+gadEcsb5X8wCgnV1QgTfr8hXhNjIL+Cfa4rOH jngAn0kE/tXSUO6ByddN09jUwPYiomyO =s0Ze -----END PGP SIGNATURE-----
list David Mills
Thanks, James. That did solve the problem. Just so I know, what script did you modify so that the client does not start up automatically on boot, and also, what file(s?) would I check to confirm that the client collection was not running if I should run across this again on a different host? Thanks again... david
▸
From: user-a3657aa747eb@xymon.invalid [mailto:user-a3657aa747eb@xymon.invalid] On Behalf Of James Wade
Sent: Tuesday, October 16, 2012 12:21 PM
To: Mills, David (IS)
Cc: xymon at xymon.com; Benjamin P. August
Subject: EXT :Re: [Xymon] Plagued by purple
I was one of the original installers of this installation. In this case, we modified scripts and ran the client separately from $XYMONHOME/client
Start the client by changing to the $XYMONHOME/client directory and running, runclient.sh start
That should resolve your issue.
James
On Tue, Oct 16, 2012 at 11:53 AM, Benjamin P. August <user-e992dd5eb2a5@xymon.invalid<mailto:user-e992dd5eb2a5@xymon.invalid>> wrote:
It looks like the green tests are all standard Xymon tests and the purple ones might be external scripts in client/ext/ in the Xymon (or Hobbit) home directory.
Check the client/etc/clientlaunch.cfg on any of the purple-plagued clients and see if any of the purple tests are mentioned.
From: "David Mills (IS)" <user-eb64c112f0e9@xymon.invalid<mailto:user-eb64c112f0e9@xymon.invalid>>
To: xymon at xymon.com<mailto:xymon at xymon.com>
Sent: Tuesday, October 16, 2012 9:48:46 AM
Subject: Re: [Xymon] Plagued by purpleJosh Luthman user-4c45a83f15cb@xymon.invalid <mailto:xymon%40xymon.com?Subject=Re%3A%20%5BXymon%5D%20Plagued%20by%20purple&In-Reply-To=user-227d6358e221@xymon.invalid%3E> Either the server isn't gathering it or the clients aren't sending the data. The raid script that I have is sent by the client.
Thanks, Josh, but can you point out where I can check to see which of those options is my likely culprit? Also, don't quite follow your comment about your "raid script". What raid script? Sorry! David
On Oct 16, 2012 2:08 AM, "Mills, David (IS)" <user-eb64c112f0e9@xymon.invalid<http://ngc.com>>; wrote:All . Am fairly new to Xymon and apologize if this is documented somewhere and I missed it. I have inherited a Xymon server (4.3.3 on Solaris 10) which shows itself as having about half its tests as .purple., the other half as green. As far as I can tell, everything.s running just fine. It seems to be a simple data refresh problem of some sort, but haven.t been able prove my hunch. The problem started after a reboot of the server. Everything came up OK, except for the following list of .missing. tests: Purple Tests: iostat iostat2 mem2 meta nfs prtdiag raid sar tm zones Green Tests: bbd conn cpu disk http info memory msgs ntp ports procs ssh trends I.ve restarted the server: (.$xymon_home/xymon.sh restart.) and tried to find something in the logs, but am not making ground on this fast enough. Help? Thanks! david
~~~~~~~~~~~~~~~~~~~ David Mills Systems Administrator Northrop Grumman
XXX-XXX-XXXX<tel:XXX-XXX-XXXX>
user-eb64c112f0e9@xymon.invalid<mailto:user-eb64c112f0e9@xymon.invalid>