Client test problems on Xymon server 4.2.3
list Ryan Novosielski
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks! - -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkxRoHgACgkQmb+gadEcsb4gzACg2xVhE07EpvJ/Vzh2s2w9bIue 4kAAnRpPhAdEWCsGZCfeflsJ1pV+Pcnz =36R/ -----END PGP SIGNATURE-----
list Josh Luthman
What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX
▸
On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote:-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks! - -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkxRoHgACgkQmb+gadEcsb4gzACg2xVhE07EpvJ/Vzh2s2w9bIue 4kAAnRpPhAdEWCsGZCfeflsJ1pV+Pcnz =36R/ -----END PGP SIGNATURE-----
list Ryan Novosielski
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The operating system. 137 patches I think it was. Though I agree, the timing is suspicious, I'm not sure that that could be the cause (unless it changed an ld config file or something). I don't see any log output that would indicate what is happening, and like I said, the data file are written to $HOBBITCLIENTHOME/tmp.
▸
On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!
- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkxRpXIACgkQmb+gadEcsb4plQCfUTX5r+JvbZ4i98IZURrw5BLQ
XRUAn3N+zTlZ0cGqB3dXbujMlSQrV6Qu
=TYsD
-----END PGP SIGNATURE-----
list Josh Luthman
Can you share what the log says? Maybe someone will spark an idea or be able to identify where the issue lays.
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
▸
On Thu, Jul 29, 2010 at 11:59 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote:-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The operating system. 137 patches I think it was. Though I agree, the timing is suspicious, I'm not sure that that could be the cause (unless it changed an ld config file or something). I don't see any log output that would indicate what is happening, and like I said, the data file are written to $HOBBITCLIENTHOME/tmp. On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkxRpXIACgkQmb+gadEcsb4plQCfUTX5r+JvbZ4i98IZURrw5BLQ XRUAn3N+zTlZ0cGqB3dXbujMlSQrV6Qu =TYsD -----END PGP SIGNATURE-----
list Ryan Novosielski
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Which log/logs do you think might be helpful?
▸
On 07/29/2010 12:03 PM, Josh Luthman wrote:Can you share what the log says? Maybe someone will spark an idea or be able to identify where the issue lays. On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!
- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkxRqesACgkQmb+gadEcsb5l6gCcC17yGEQVajRQP+5yvcMadxOz
oVoAoKZmxbusVcyOjV5BueWqoS8TWAwz
=I8vC
-----END PGP SIGNATURE-----
list Ralph Mitchell
Did you recompile xymon?? If those 137 patches include libraries xymon is linked against, maybe something is a bit different now? Ralph Mitchell
▸
On Thu, Jul 29, 2010 at 11:59 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid>wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The operating system. 137 patches I think it was. Though I agree, the timing is suspicious, I'm not sure that that could be the cause (unless it changed an ld config file or something). I don't see any log output that would indicate what is happening, and like I said, the data file are written to $HOBBITCLIENTHOME/tmp. On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkxRpXIACgkQmb+gadEcsb4plQCfUTX5r+JvbZ4i98IZURrw5BLQ XRUAn3N+zTlZ0cGqB3dXbujMlSQrV6Qu =TYsD -----END PGP SIGNATURE-----
list Ralph Mitchell
Did you recompile xymon?? If those 137 patches include libraries xymon is linked against, maybe something is a bit different now? Ralph Mitchell On Thu, Jul 29, 2010 at 11:59 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid>wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The operating system. 137 patches I think it was. Though I agree, the timing is suspicious, I'm not sure that that could be the cause (unless it changed an ld config file or something). I don't see any log output that would indicate what is happening, and like I said, the data file are written to $HOBBITCLIENTHOME/tmp. On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkxRpXIACgkQmb+gadEcsb4plQCfUTX5r+JvbZ4i98IZURrw5BLQ XRUAn3N+zTlZ0cGqB3dXbujMlSQrV6Qu =TYsD -----END PGP SIGNATURE-----
list Josh Luthman
Would be easy to recompile... I would start with clientdata.log - mine looks like this: -> more clientdata.log 2009-12-05 16:05:46 Tried to down BOARDBUSY: Invalid argument Shutting down 2009-12-05 16:05:46 Worker process died with exit code 0, terminating 2010-04-04 22:46:51 Worker process died with exit code 15, terminating 2010-04-05 00:09:56 Worker process died with exit code 15, terminating 2010-06-07 02:33:41 Worker process died with exit code 15, terminating 2010-07-05 13:08:14 Tried to down BOARDBUSY: Invalid argument 2010-07-28 13:39:16 Tried to down BOARDBUSY: Invalid argument Shutting down 2010-07-28 13:39:16 Worker process died with exit code 0, terminating
▸
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
On Thu, Jul 29, 2010 at 12:20 PM, Ralph Mitchell
▸
<user-00a5e44c48c0@xymon.invalid> wrote:Did you recompile xymon?? If those 137 patches include libraries xymon is linked against, maybe something is a bit different now? Ralph Mitchell On Thu, Jul 29, 2010 at 11:59 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote:-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The operating system. 137 patches I think it was. Though I agree, the timing is suspicious, I'm not sure that that could be the cause (unless it changed an ld config file or something). I don't see any log output that would indicate what is happening, and like I said, the data file are written to $HOBBITCLIENTHOME/tmp. On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkxRpXIACgkQmb+gadEcsb4plQCfUTX5r+JvbZ4i98IZURrw5BLQ XRUAn3N+zTlZ0cGqB3dXbujMlSQrV6Qu =TYsD -----END PGP SIGNATURE-----
list Ryan Novosielski
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Yes, I may try to recompile. I would say, though, it would be the first time I've had to recompile anything after running OS patches. My clientdata.log has nothing remotely recent in it.
▸
On 07/29/2010 12:31 PM, Josh Luthman wrote:Would be easy to recompile... I would start with clientdata.log - mine looks like this: -> more clientdata.log 2009-12-05 16:05:46 Tried to down BOARDBUSY: Invalid argument Shutting down 2009-12-05 16:05:46 Worker process died with exit code 0, terminating 2010-04-04 22:46:51 Worker process died with exit code 15, terminating 2010-04-05 00:09:56 Worker process died with exit code 15, terminating 2010-06-07 02:33:41 Worker process died with exit code 15, terminating 2010-07-05 13:08:14 Tried to down BOARDBUSY: Invalid argument 2010-07-28 13:39:16 Tried to down BOARDBUSY: Invalid argument Shutting down 2010-07-28 13:39:16 Worker process died with exit code 0, terminating Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 12:20 PM, Ralph Mitchell <user-00a5e44c48c0@xymon.invalid> wrote:Did you recompile xymon?? If those 137 patches include libraries xymon is linked against, maybe something is a bit different now? Ralph Mitchell On Thu, Jul 29, 2010 at 11:59 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote:The operating system. 137 patches I think it was. Though I agree, the timing is suspicious, I'm not sure that that could be the cause (unless it changed an ld config file or something). I don't see any log output that would indicate what is happening, and like I said, the data file are written to $HOBBITCLIENTHOME/tmp. On 07/29/2010 11:42 AM, Josh Luthman wrote:What did you patch? Permissions issue? Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX On Thu, Jul 29, 2010 at 11:38 AM, Ryan Novosielski <user-ae4522577e16@xymon.invalid> wrote: Good morning, Just ran into an odd problem on my Xymon server that I hope someone might help me diagnose. I run the server software on Solaris 9 and I allow the server program to run the client part out of hobbitlaunch.cfg. This has worked in the past. After patching and rebooting, however, suddenly the external tests never make it to the web interface and ultimately turn purple. The processes run, they write to the tmp directory of the client, but that's as far as it goes. All of the built-in tests work fine. Any idea what to look at? Thanks!
- -- - ---- _ _ _ _ ___ _ _ _ |Y#| | | |\/| | \ |\ | | |Ryan Novosielski - Sr. Systems Programmer |$&| |__| | | |__/ | \| _| |user-ae4522577e16@xymon.invalid - 973/972.0922 (2-0922) \__/ Univ. of Med. and Dent.|IST/CST-Academic Svcs. - ADMC 450, Newark -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkxRr44ACgkQmb+gadEcsb6vqACgopuKTGaVsMBZk7O5quxRSSvi
JJAAn2+JlsRUuRkke336y462K1kg5W9M
=K8RE
-----END PGP SIGNATURE-----