Hobbitd constantly yellow
list Brian Thompson
Hello, I've recently been tasked with restoring functionality to a hobbit server that suffered a corrupted root directory. We had a ghost image of the server (running Ubuntu 6) but it lacked the ability to send alerts. I restored that functionality and now I'm getting a constant hobbitd as yellow, and I'm not even sure what that means. In the past 9 hours the "incoming messages" has grown from 113k to 120k, most of them are status messages. Where are these messages and what are they? I'm still completely oblivious in the realm of hobbit, I checked the man pages and couldn't make much sense of them in this respect. Thanks for any help in advance. Brian Thompson
list Tod Hansmann
What are the errors on the bottom and/or top of the alarm's page? I imagine you have status messages coming in for hosts that you don't have in your bb-hosts file anymore or something similar to that. The error messages will tell us more. Tod Hansmann Network Engineer
▸
From: Thompson, Brian [mailto:user-1664ec030a9d@xymon.invalid]
Sent: Monday, April 23, 2007 7:22 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] Hobbitd constantly yellow
Hello,
I've recently been tasked with restoring functionality to a hobbit server that suffered a corrupted root directory. We had a ghost image of the server (running Ubuntu 6) but it lacked the ability to send alerts. I restored that functionality and now I'm getting a constant hobbitd as yellow, and I'm not even sure what that means. In the past 9 hours the "incoming messages" has grown from 113k to 120k, most of them are status messages.
Where are these messages and what are they? I'm still completely oblivious in the realm of hobbit, I checked the man pages and couldn't make much sense of them in this respect.
Thanks for any help in advance.
Brian Thompson
list Brian Thompson
My most recent alert as of less than a minute ago... Latest errormessages: Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.panalyse Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pcdb Ignored PURPLE status update from 53.215.63.xx for PkgPRI-pings.ddc.cnctr_1 Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.ptime Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.net Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pif Ignored PURPLE status update from 53.215.63.xx for PkgPRI-pings.ddc.websrv Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.load Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.ora Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.orats Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pback Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.papst As far as I know all of these services are still active. I wasn't the one to set this thing up (unfortunately) so I'm not sure if our image was incomplete. Thanks, Brian Thompson
▸
-----Original Message-----
From: Tod Hansmann [mailto:user-b6e28cb93fa4@xymon.invalid] Sent: Monday, April 23, 2007 10:12 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Hobbitd constantly yellow
What are the errors on the bottom and/or top of the alarm's page? I imagine you have status messages coming in for hosts that you don't have in your bb-hosts file anymore or something similar to that. The error messages will tell us more.
Tod Hansmann
Network Engineer
From: Thompson, Brian [mailto:user-1664ec030a9d@xymon.invalid] Sent: Monday, April 23, 2007 7:22 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] Hobbitd constantly yellow
Hello, I've recently been tasked with restoring functionality to a hobbit server that suffered a corrupted root directory. We had a ghost image of the server (running Ubuntu 6) but it lacked the ability to send alerts. I restored that functionality and now I'm getting a constant hobbitd as yellow, and I'm not even sure what that means. In the past 9 hours the "incoming messages" has grown from 113k to 120k, most of them are status messages.
Where are these messages and what are they? I'm still completely oblivious in the realm of hobbit, I checked the man pages and couldn't make much sense of them in this respect.
Thanks for any help in advance. Brian Thompson
list Tod Hansmann
Looks like something is out of place. I'd take a look at your bb-hosts file and see if PkgPRI.ddc is still in there and not commented out. If it is, I'm not sure why it would alarm, but that box (53.215.63.xx) is reporting stuff for it. It seems to me to be a separate system reporting on some custom tests. If that's the case, you may be in a pickle trying to figure out what it's doing. Let me know what you find and if I can help further. Tod Hansmann Network Engineer
▸
-----Original Message-----
From: Thompson, Brian [mailto:user-1664ec030a9d@xymon.invalid] Sent: Monday, April 23, 2007 8:20 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Hobbitd constantly yellow
My most recent alert as of less than a minute ago...
Latest errormessages:
Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.panalyse Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pcdb Ignored PURPLE status update from 53.215.63.xx for PkgPRI-pings.ddc.cnctr_1 Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.ptime Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.net Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pif Ignored PURPLE status update from 53.215.63.xx for PkgPRI-pings.ddc.websrv Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.load Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.ora Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.orats Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pback Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.papst
As far as I know all of these services are still active. I wasn't the one to set this thing up (unfortunately) so I'm not sure if our image was incomplete.
Thanks,
Brian Thompson
-----Original Message-----
From: Tod Hansmann [mailto:user-b6e28cb93fa4@xymon.invalid] Sent: Monday, April 23, 2007 10:12 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Hobbitd constantly yellow
What are the errors on the bottom and/or top of the alarm's page? I imagine you have status messages coming in for hosts that you don't have in your bb-hosts file anymore or something similar to that. The error messages will tell us more.
Tod Hansmann
Network Engineer
From: Thompson, Brian [mailto:user-1664ec030a9d@xymon.invalid] Sent: Monday, April 23, 2007 7:22 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] Hobbitd constantly yellow
Hello, I've recently been tasked with restoring functionality to a hobbit server that suffered a corrupted root directory. We had a ghost image of the server (running Ubuntu 6) but it lacked the ability to send alerts. I restored that functionality and now I'm getting a constant hobbitd as yellow, and I'm not even sure what that means. In the past 9 hours the "incoming messages" has grown from 113k to 120k, most of them are status messages.
Where are these messages and what are they? I'm still completely oblivious in the realm of hobbit, I checked the man pages and couldn't make much sense of them in this respect.
Thanks for any help in advance. Brian Thompson
list Brian Thompson
Hrm, I checked my bbhosts file and all looks to be in order. I wonder if a bad network connection from that box could be causing the issue? It's a whole lot of "not reporting", could it be extreme latency issues that could cause this? Brian Thompson EDS - Package Support (XXX)-XXX-XXXX Detroit Diesel, Redford, MI
▸
-----Original Message-----
From: Tod Hansmann [mailto:user-b6e28cb93fa4@xymon.invalid] Sent: Monday, April 23, 2007 10:36 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Hobbitd constantly yellow
Looks like something is out of place. I'd take a look at your bb-hosts file and see if PkgPRI.ddc is still in there and not commented out. If it is, I'm not sure why it would alarm, but that box (53.215.63.xx) is reporting stuff for it. It seems to me to be a separate system reporting on some custom tests. If that's the case, you may be in a pickle trying to figure out what it's doing.
Let me know what you find and if I can help further.
Tod Hansmann
Network Engineer
-----Original Message-----
From: Thompson, Brian [mailto:user-1664ec030a9d@xymon.invalid] Sent: Monday, April 23, 2007 8:20 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Hobbitd constantly yellow
My most recent alert as of less than a minute ago...
Latest errormessages:
Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.panalyse Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pcdb Ignored PURPLE status update from 53.215.63.xx for PkgPRI-pings.ddc.cnctr_1 Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.ptime Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.net Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pif Ignored PURPLE status update from 53.215.63.xx for PkgPRI-pings.ddc.websrv Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.load Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.ora Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.orats Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.pback Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.papst
As far as I know all of these services are still active. I wasn't the one to set this thing up (unfortunately) so I'm not sure if our image was incomplete.
Thanks,
Brian Thompson
-----Original Message-----
From: Tod Hansmann [mailto:user-b6e28cb93fa4@xymon.invalid] Sent: Monday, April 23, 2007 10:12 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Hobbitd constantly yellow
What are the errors on the bottom and/or top of the alarm's page? I imagine you have status messages coming in for hosts that you don't have in your bb-hosts file anymore or something similar to that. The error messages will tell us more.
Tod Hansmann
Network Engineer
From: Thompson, Brian [mailto:user-1664ec030a9d@xymon.invalid] Sent: Monday, April 23, 2007 7:22 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] Hobbitd constantly yellow
Hello, I've recently been tasked with restoring functionality to a hobbit server that suffered a corrupted root directory. We had a ghost image of the server (running Ubuntu 6) but it lacked the ability to send alerts. I restored that functionality and now I'm getting a constant hobbitd as yellow, and I'm not even sure what that means. In the past 9 hours the "incoming messages" has grown from 113k to 120k, most of them are status messages.
Where are these messages and what are they? I'm still completely oblivious in the realm of hobbit, I checked the man pages and couldn't make much sense of them in this respect.
Thanks for any help in advance. Brian Thompson
list Henrik Størner
▸
On Mon, Apr 23, 2007 at 10:19:53AM -0400, Thompson, Brian wrote:
My most recent alert as of less than a minute ago... Latest errormessages: Ignored PURPLE status update from 53.215.63.xx for PkgPRI.ddc.panalyse
The user-2c03ad21985c@xymon.invalid is sending status messages to Hobbit with the
color set to "purple". That's a no-no : "purple" is a reserved color and
is handled entirely inside the Hobbit daemon, it cannot be generated by
an external source.
It's has to be a custom script that generates this status. If it has no
data to report, then it should either use a "clear" status, or stop
sending reports completely (in which case the status will change to purple
in Hobbit automatically).
Regards,
Henrik