Argh, see here for workaround.
http://hobbitmon.sourceforge.net/docs/known-issues.html#dnserror
So DNS server change failed the ares library.
tj
From: "T.J. Yang" <user-8e841282cda5@xymon.invalid>
Sent: Wednesday, July 30, 2008 8:24 AM
To: <user-ae9b8668bcde@xymon.invalid>
Subject: [hobbit] http checking return "DNS error" message
Recently I have a DNS servers change on hobbit server. Ever since then http service checking are Tue Jul 29 14:56:47 2008
So far I have done following.
1. make sure dns is in /etc/nsswitch.conf host entry.
2. ping terminal.sub.test.com works.
3. /etc/resolv.conf is configured with new dns servers and their ips.
4. clean out "/var/opt/hobbitserver42/tmp/*..status files and restart hobbit server.
Is there any better way to debug the issue ?
1. Example error message.
Wed Jul 30 07:50:51 2008: DNS error
http://terminal.sub.test.com/ - DNS error
Seconds: 0.00
2. The batch http checking showing flip-flop on all the machines with http checking.
Tue Jul 29 14:56:47 2008 terminal.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 ltelinux3-sol.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 ltelinux2-sol.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 itsupport.corp.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 isdweb1.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 isdeclinux3-rsa.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 isdeclinux2-rsa.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 isdeclinux1-rsa.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 dd403.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 dd402.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 dd401.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 dd400.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 li66nsdbm.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 iclinux01-sol.corp.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 hobbit2.sub.test.com http red From -> To green
Tue Jul 29 14:56:47 2008 bs713.sub.test.com http red From -> To green
Tue Jul 29 14:56:20 2008 terminal.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 ltelinux3-sol.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 ltelinux2-sol.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 itsupport.corp.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 isdweb1.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 isdeclinux3-rsa.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 isdeclinux2-rsa.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 isdeclinux1-rsa.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 dd403.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 dd402.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 dd401.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 dd400.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 li66nsdbm.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 iclinux01-sol.corp.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 hobbit2.sub.test.com http green From -> To red
Tue Jul 29 14:56:20 2008 bs713.sub.test.com http green From -> To red
T.J. Yang
With Windows Live for mobile, your contacts travel with you.
http://www.windowslive.com/mobile/overview.html?ocid=TXT_TAGLM_WL_mobile_072008