Xymon Mailing List Archive search

http checking return "DNS error" message

6 messages in this thread

list T.J. Yang · Wed, 30 Jul 2008 08:24:34 -0500 ·
Recently I have a DNS servers change on hobbit server. Ever since then http service checking are Tue Jul 29 14:56:47 2008     

So far I have done following.

1. make sure dns is in /etc/nsswitch.conf host entry.
2. ping terminal.sub.test.com works.
3. /etc/resolv.conf is configured with new dns servers and their ips.
4.  clean out "/var/opt/hobbitserver42/tmp/*..status files and restart hobbit server.

Is there any better way to debug the issue ?

1. Example error message.

Wed Jul 30 07:50:51 2008: DNS error

http://terminal.sub.test.com/ - DNS error


Seconds:     0.00

2. The batch http checking showing flip-flop on all the machines with http checking.

Tue Jul 29 14:56:47 2008        terminal.sub.test.com   http    red From -> To  green
Tue Jul 29 14:56:47 2008        ltelinux3-sol.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        ltelinux2-sol.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        itsupport.corp.test.com         http    red From -> To  green
Tue Jul 29 14:56:47 2008        isdweb1.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        isdeclinux3-rsa.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        isdeclinux2-rsa.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        isdeclinux1-rsa.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd403.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd402.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd401.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd400.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        li66nsdbm.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        iclinux01-sol.corp.test.com     http    red From -> To  green
Tue Jul 29 14:56:47 2008        hobbit2.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        bs713.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:20 2008        terminal.sub.test.com   http    green From -> To        red
Tue Jul 29 14:56:20 2008        ltelinux3-sol.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        ltelinux2-sol.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        itsupport.corp.test.com         http    green From -> To        red
Tue Jul 29 14:56:20 2008        isdweb1.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        isdeclinux3-rsa.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        isdeclinux2-rsa.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        isdeclinux1-rsa.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd403.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd402.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd401.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd400.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        li66nsdbm.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        iclinux01-sol.corp.test.com     http    green From -> To        red
Tue Jul 29 14:56:20 2008        hobbit2.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        bs713.sub.test.com      http    green From -> To        red


T.J. Yang

With Windows Live for mobile, your contacts travel with you.
http://www.windowslive.com/mobile/overview.html?ocid=TXT_TAGLM_WL_mobile_072008
list T.J. Yang · Wed, 30 Jul 2008 08:31:50 -0500 ·
quoted from T.J. Yang

From: "T.J. Yang" <user-8e841282cda5@xymon.invalid>
Sent: Wednesday, July 30, 2008 8:24 AM
To: <user-ae9b8668bcde@xymon.invalid>
Subject: [hobbit] http checking return "DNS error" message
Recently I have a DNS servers change on hobbit server.
Ever since then http service checking are Tue Jul 29 14:56:47 2008
                                                                             
^^^^^^^^^^^^^^^^^^^^^^^^ flip-flopping, I meant.


tj
list T.J. Yang · Wed, 30 Jul 2008 09:05:01 -0500 ·
Argh, see here for workaround.
http://hobbitmon.sourceforge.net/docs/known-issues.html#dnserror

So DNS server change failed the ares library.


tj
quoted from T.J. Yang
From: "T.J. Yang" <user-8e841282cda5@xymon.invalid>
Sent: Wednesday, July 30, 2008 8:24 AM
To: <user-ae9b8668bcde@xymon.invalid>
Subject: [hobbit] http checking return "DNS error" message
Recently I have a DNS servers change on hobbit server. Ever since then http service checking are Tue Jul 29 14:56:47 2008

So far I have done following.

1. make sure dns is in /etc/nsswitch.conf host entry.
2. ping terminal.sub.test.com works.
3. /etc/resolv.conf is configured with new dns servers and their ips.
4.  clean out "/var/opt/hobbitserver42/tmp/*..status files and restart hobbit server.

Is there any better way to debug the issue ?

1. Example error message.

Wed Jul 30 07:50:51 2008: DNS error

http://terminal.sub.test.com/ - DNS error


Seconds:     0.00

2. The batch http checking showing flip-flop on all the machines with http checking.

Tue Jul 29 14:56:47 2008        terminal.sub.test.com   http    red From -> To  green
Tue Jul 29 14:56:47 2008        ltelinux3-sol.sub.test.com      http red From -> To  green
Tue Jul 29 14:56:47 2008        ltelinux2-sol.sub.test.com      http red From -> To  green
Tue Jul 29 14:56:47 2008        itsupport.corp.test.com         http red From -> To  green
Tue Jul 29 14:56:47 2008        isdweb1.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        isdeclinux3-rsa.sub.test.com    http red From -> To  green
Tue Jul 29 14:56:47 2008        isdeclinux2-rsa.sub.test.com    http red From -> To  green
Tue Jul 29 14:56:47 2008        isdeclinux1-rsa.sub.test.com    http red From -> To  green
Tue Jul 29 14:56:47 2008        dd403.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd402.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd401.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        dd400.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        li66nsdbm.test.com      http    red From -> To  green
Tue Jul 29 14:56:47 2008        iclinux01-sol.corp.test.com     http red From -> To  green
Tue Jul 29 14:56:47 2008        hobbit2.sub.test.com    http    red From -> To  green
Tue Jul 29 14:56:47 2008        bs713.sub.test.com      http    red From -> To  green
Tue Jul 29 14:56:20 2008        terminal.sub.test.com   http    green From -> To        red
Tue Jul 29 14:56:20 2008        ltelinux3-sol.sub.test.com      http green From -> To        red
Tue Jul 29 14:56:20 2008        ltelinux2-sol.sub.test.com      http green From -> To        red
Tue Jul 29 14:56:20 2008        itsupport.corp.test.com         http green From -> To        red
Tue Jul 29 14:56:20 2008        isdweb1.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        isdeclinux3-rsa.sub.test.com    http green From -> To        red
Tue Jul 29 14:56:20 2008        isdeclinux2-rsa.sub.test.com    http green From -> To        red
Tue Jul 29 14:56:20 2008        isdeclinux1-rsa.sub.test.com    http green From -> To        red
Tue Jul 29 14:56:20 2008        dd403.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd402.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd401.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        dd400.sub.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        li66nsdbm.test.com      http    green From -> To        red
Tue Jul 29 14:56:20 2008        iclinux01-sol.corp.test.com     http green From -> To        red
Tue Jul 29 14:56:20 2008        hobbit2.sub.test.com    http    green From -> To        red
Tue Jul 29 14:56:20 2008        bs713.sub.test.com      http    green From -> To        red


T.J. Yang

With Windows Live for mobile, your contacts travel with you.
http://www.windowslive.com/mobile/overview.html?ocid=TXT_TAGLM_WL_mobile_072008

list Vernon Everett · Thu, 31 Jul 2008 14:21:46 +0800 ·
Hi all

Interesting problem here.
Trying to graph some data.
Output is all OK, test looks good, some information appears, and
somewhere in the status are the single lines
Data1=value1
Data2=value2
All good.

Problem though, in the status text that appears on the screen, there are
some colons. :
As we all know, the ncv module can use information in the form
Data1=value1 Or Data1 : value1
So it's interpreting those lines with the : as graph data, and trying to
stick it into the rrd file, with somewhat tragic results.

Any idea how to convince the ncv graphing module to ignore the : as a
data seperator, and only look at = ?

Cheers
     Vernon


NOTICE: This email and any attachments are confidential. They may contain legally privileged information or copyright material. You must not read, copy, use or disclose them without authorisation. If you are not an intended recipient, please contact us at once by return email and then delete both messages and all attachments.
list Phil Wild · Thu, 31 Jul 2008 14:57:33 +0800 ·
Why not pre-process the data before it gets to hobbit and remove the ":"'s?

Phil

2008/7/31 Everett, Vernon <user-9da1a1882f49@xymon.invalid>:
quoted from Vernon Everett
Hi all

Interesting problem here.
Trying to graph some data.
Output is all OK, test looks good, some information appears, and
somewhere in the status are the single lines
Data1=value1
Data2=value2
All good.

Problem though, in the status text that appears on the screen, there are
some colons. :
As we all know, the ncv module can use information in the form
Data1=value1
Or
Data1 : value1
So it's interpreting those lines with the : as graph data, and trying to
stick it into the rrd file, with somewhat tragic results.

Any idea how to convince the ncv graphing module to ignore the : as a
data seperator, and only look at = ?

Cheers
    Vernon


NOTICE: This email and any attachments are confidential.
They may contain legally privileged information or
copyright material. You must not read, copy, use or
disclose them without authorisation. If you are not an
intended recipient, please contact us at once by return
email and then delete both messages and all attachments.

-- 

Tel: XXXX XXX XXX
Fax: XXXX XXX XXX
email: user-e365c1418192@xymon.invalid
list Vernon Everett · Thu, 31 Jul 2008 15:00:26 +0800 ·
We can do that, but I was hoping not to.
The info is ip:port, which is traditionally displayed with a :
If we have to, I will.
quoted from Phil Wild
 
-----Original Message-----
From: Phil Wild [mailto:user-e365c1418192@xymon.invalid] Sent: Thursday, 31 July 2008 4:58 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] More rrd graphing - how to ignore :

Why not pre-process the data before it gets to hobbit and remove the
":"'s?

Phil

2008/7/31 Everett, Vernon <user-9da1a1882f49@xymon.invalid>:
Hi all

Interesting problem here.
Trying to graph some data.
Output is all OK, test looks good, some information appears, and somewhere in the status are the single lines
Data1=value1
Data2=value2
All good.

Problem though, in the status text that appears on the screen, there are some colons. :
As we all know, the ncv module can use information in the form
Data1=value1
Or
Data1 : value1
So it's interpreting those lines with the : as graph data, and trying to stick it into the rrd file, with somewhat tragic results.

Any idea how to convince the ncv graphing module to ignore the : as a data seperator, and only look at = ?

Cheers
    Vernon


NOTICE: This email and any attachments are confidential.
They may contain legally privileged information or copyright material.
You must not read, copy, use or disclose them without authorisation. If you are not an intended recipient, please contact us at once by return email and then delete both messages and all attachments.

--
Tel: XXXX XXX XXX
Fax: XXXX XXX XXX
email: user-e365c1418192@xymon.invalid


NOTICE: This email and any attachments are confidential. They may contain legally privileged information or copyright material. You must not read, copy, use or disclose them without authorisation. If you are not an intended recipient, please contact us at once by return email and then delete both messages and all attachments.