hobbitd_rrd crashing

7 messages in this thread

list Geoff Hallford · Tue, 17 Aug 2010 09:24:15 -0400 ·

Hi All,

Hopefully someone can help with this issue. hobbitd_rrd keeps crashing and
popping up as red on my xymon installation. I am running 4.3.0-0 beta 2.
Here is the dump of the core file:

xymon at xymon:~/server> gdb bin/hobbitd_rrd tmp/core
GNU gdb (GDB) SUSE (7.1-3.12)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html

This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>;...
Reading symbols from /home/xymon/server/bin/hobbitd_rrd...done.
[New Thread 8252]
Core was generated by `hobbitd_rrd --rrddir=/home/xymon/data/rrd'.
Program terminated with signal 6, Aborted.
#0  0xffffe424 in __kernel_vsyscall ()

(gdb) bt
#0  0xffffe424 in __kernel_vsyscall ()
#1  0xb75937ff in raise () from /lib/libc.so.6
#2  0xb7595140 in abort () from /lib/libc.so.6
#3  0x080666d3 in sigsegv_handler (signum=11) at sig.c:57
#4  <signal handler called>
#5  0xb75de4a3 in strlen () from /lib/libc.so.6
#6  0xb75de1a6 in strdup () from /lib/libc.so.6
#7  0xb777ed16 in rrd_update () from /usr/lib/librrd.so.4
#8  0x0804c217 in flush_cached_updates (cacheitem=0x80d4030, newdata=<value
optimized out>) at do_rrd.c:225
#9  0x0804d2dc in create_and_update_rrd (hostname=<value optimized out>,
testname=0xb6e17a8a "if_load", classname=<value optimized out>,
pagepaths=0x806d031 "", creparams=0xbfc280a4,
    template=0x80d4970) at do_rrd.c:404
#10 0x08057a26 in do_devmon_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", classname=0xb6e17abe "uhn/uhnnetwork",
pagepaths=0x806d031 "", msg=
    0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18 2010",
tstamp=1282049718) at rrd/do_devmon.c:111
#11 0x08058bf6 in update_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", msg=0xb6e17acd "status VPN04,uhn,ca.if_load
green Tue Aug 17 08:55:18 2010", tstamp=
    1282049718, sender=0xb6e17a72 "127.0.0.1", ldef=0x809e490,
classname=0xb6e17abe "uhn/uhnnetwork", pagepaths=0x806d031 "") at
do_rrd.c:660
#12 0x0804a906 in main (argc=2, argv=0xbfc2b444) at hobbitd_rrd.c:366

list Buchan Milne · Wed, 18 Aug 2010 16:17:51 +0100 ·

▸ quoted from Geoff Hallford

On Tuesday, 17 August 2010 14:24:15 Geoff Hallford wrote:

Hi All,

Hopefully someone can help with this issue. hobbitd_rrd keeps crashing and
popping up as red on my xymon installation. I am running 4.3.0-0 beta 2.

Is there a good reason you are running a beta version?

Can you supply the contents of the test, e.g. the output of:

$ bb localhost 'hobbitdlog VPN04.uhn.ca if_load'

Specifically, you would be looking for spaces in interface names.

▸ quoted from Geoff Hallford

Here is the dump of the core file:

xymon at xymon:~/server> gdb bin/hobbitd_rrd tmp/core
GNU gdb (GDB) SUSE (7.1-3.12)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html

This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>;...
Reading symbols from /home/xymon/server/bin/hobbitd_rrd...done.
[New Thread 8252]
Core was generated by `hobbitd_rrd --rrddir=/home/xymon/data/rrd'.
Program terminated with signal 6, Aborted.
#0  0xffffe424 in __kernel_vsyscall ()

(gdb) bt
#0  0xffffe424 in __kernel_vsyscall ()
#1  0xb75937ff in raise () from /lib/libc.so.6
#2  0xb7595140 in abort () from /lib/libc.so.6
#3  0x080666d3 in sigsegv_handler (signum=11) at sig.c:57
#4  <signal handler called>
#5  0xb75de4a3 in strlen () from /lib/libc.so.6
#6  0xb75de1a6 in strdup () from /lib/libc.so.6
#7  0xb777ed16 in rrd_update () from /usr/lib/librrd.so.4
#8  0x0804c217 in flush_cached_updates (cacheitem=0x80d4030, newdata=<value
optimized out>) at do_rrd.c:225
#9  0x0804d2dc in create_and_update_rrd (hostname=<value optimized out>,
testname=0xb6e17a8a "if_load", classname=<value optimized out>,
pagepaths=0x806d031 "", creparams=0xbfc280a4,
    template=0x80d4970) at do_rrd.c:404
#10 0x08057a26 in do_devmon_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", classname=0xb6e17abe "uhn/uhnnetwork",
pagepaths=0x806d031 "", msg=
    0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18
2010", tstamp=1282049718) at rrd/do_devmon.c:111

I think this is a known issue with the devmon collector for 4.3.x. It is fixed 
in 4.2.x, but the other changes in 4.3 regarding RRD collection mean the fix 
didn't apply to 4.3.x.

▸ quoted from Geoff Hallford

#11 0x08058bf6 in update_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", msg=0xb6e17acd "status VPN04,uhn,ca.if_load
green Tue Aug 17 08:55:18 2010", tstamp=
    1282049718, sender=0xb6e17a72 "127.0.0.1", ldef=0x809e490,
classname=0xb6e17abe "uhn/uhnnetwork", pagepaths=0x806d031 "") at
do_rrd.c:660
#12 0x0804a906 in main (argc=2, argv=0xbfc2b444) at hobbitd_rrd.c:366

I will try and fix it this week, I think this is avoided in the 4.2.4 branch, 
some packages of 4.2.3 ship 4.2.3 with the relevant patch, and the fix on the 
devmon side is to ensure that your template ensures that no interface names 
have spaces in them. With the xymon fix, the devmon collector will ignore data 
for interfaces with spaces in the names, so you should fix the interface names 
in any case (if you want interface load graphs for the interfaces in 
question).


Regards,
Buchan

list Bruce White · Fri, 20 Aug 2010 10:01:29 -0500 ·

I have had the same issue twice recently.  I'm running the same version
of Xymon on a RedHat 5.2 server which has been running without this
issue since October, 2009.
 
          .....Bruce


 
 Bruce White
 Senior Enterprise Systems Engineer | Phone: XXX-XXX-XXXX | Fax: XXX-XXX-XXXX | user-58f975e8bf9d@xymon.invalid | http://www.fellowes.com/
 
 
 
Disclaimer: The information contained in this message may be privileged and confidential and protected from disclosure. If the reader of this message is not the intended recipient or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. Fellowes, Inc.

▸ quoted from Geoff Hallford

From: Geoff Hallford [mailto:user-dc9e7f30b1e2@xymon.invalid] 
Sent: Tuesday, August 17, 2010 8:24 AM
To: xymon at xymon.com
Subject: [xymon] hobbitd_rrd crashing

Hi All,

Hopefully someone can help with this issue. hobbitd_rrd keeps crashing
and popping up as red on my xymon installation. I am running 4.3.0-0
beta 2. Here is the dump of the core file:

xymon at xymon:~/server> gdb bin/hobbitd_rrd tmp/core 
GNU gdb (GDB) SUSE (7.1-3.12)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>;
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>;...
Reading symbols from /home/xymon/server/bin/hobbitd_rrd...done.
[New Thread 8252]
Core was generated by `hobbitd_rrd --rrddir=/home/xymon/data/rrd'.
Program terminated with signal 6, Aborted.
#0  0xffffe424 in __kernel_vsyscall ()

(gdb) bt
#0  0xffffe424 in __kernel_vsyscall ()
#1  0xb75937ff in raise () from /lib/libc.so.6
#2  0xb7595140 in abort () from /lib/libc.so.6
#3  0x080666d3 in sigsegv_handler (signum=11) at sig.c:57
#4  <signal handler called>
#5  0xb75de4a3 in strlen () from /lib/libc.so.6
#6  0xb75de1a6 in strdup () from /lib/libc.so.6
#7  0xb777ed16 in rrd_update () from /usr/lib/librrd.so.4
#8  0x0804c217 in flush_cached_updates (cacheitem=0x80d4030,
newdata=<value optimized out>) at do_rrd.c:225
#9  0x0804d2dc in create_and_update_rrd (hostname=<value optimized out>,
testname=0xb6e17a8a "if_load", classname=<value optimized out>,
pagepaths=0x806d031 "", creparams=0xbfc280a4, 
    template=0x80d4970) at do_rrd.c:404
#10 0x08057a26 in do_devmon_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", classname=0xb6e17abe "uhn/uhnnetwork",
pagepaths=0x806d031 "", msg=
    0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18
2010", tstamp=1282049718) at rrd/do_devmon.c:111
#11 0x08058bf6 in update_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", msg=0xb6e17acd "status
VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18 2010", tstamp=
    1282049718, sender=0xb6e17a72 "127.0.0.1", ldef=0x809e490,
classname=0xb6e17abe "uhn/uhnnetwork", pagepaths=0x806d031 "") at
do_rrd.c:660
#12 0x0804a906 in main (argc=2, argv=0xbfc2b444) at hobbitd_rrd.c:366

list Olivier Beau · Mon, 23 Aug 2010 09:12:40 +0200 ·

Do you have any statuses in maintenance ?


Envoyé de mon iPhone

▸ quoted from Bruce White


Le 20 août 2010 à 17:01, "White, Bruce" <user-58f975e8bf9d@xymon.invalid> a écrit :

I have had the same issue twice recently.  I'm running the same version of Xymon on a RedHat 5.2 server which has been running without this issue since October, 2009.
           .....Bruce

 
 Bruce White


 Senior Enterprise Systems Engineer | Phone: XXX-XXX-XXXX | Fax: XXX-XXX-XXXX | user-58f975e8bf9d@xymon.invalid | www.fellowes.com

▸ quoted from Bruce White

Disclaimer: The information contained in this message may be privileged and confidential and protected from disclosure. If the reader of this message is not the intended recipient or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. Fellowes, Inc.

From: Geoff Hallford [mailto:user-dc9e7f30b1e2@xymon.invalid] Sent: Tuesday, August 17, 2010 8:24 AM
To: xymon at xymon.com
Subject: [xymon] hobbitd_rrd crashing

Hi All,

Hopefully someone can help with this issue. hobbitd_rrd keeps crashing and popping up as red on my xymon installation. I am running 4.3.0-0 beta 2. Here is the dump of the core file:

xymon at xymon:~/server> gdb bin/hobbitd_rrd tmp/core GNU gdb (GDB) SUSE (7.1-3.12)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>;
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>;...
Reading symbols from /home/xymon/server/bin/hobbitd_rrd...done.
[New Thread 8252]
Core was generated by `hobbitd_rrd --rrddir=/home/xymon/data/rrd'.
Program terminated with signal 6, Aborted.
#0  0xffffe424 in __kernel_vsyscall ()

(gdb) bt
#0  0xffffe424 in __kernel_vsyscall ()
#1  0xb75937ff in raise () from /lib/libc.so.6
#2  0xb7595140 in abort () from /lib/libc.so.6
#3  0x080666d3 in sigsegv_handler (signum=11) at sig.c:57
#4  <signal handler called>
#5  0xb75de4a3 in strlen () from /lib/libc.so.6
#6  0xb75de1a6 in strdup () from /lib/libc.so.6
#7  0xb777ed16 in rrd_update () from /usr/lib/librrd.so.4
#8  0x0804c217 in flush_cached_updates (cacheitem=0x80d4030, newdata=<value optimized out>) at do_rrd.c:225
#9  0x0804d2dc in create_and_update_rrd (hostname=<value optimized out>, testname=0xb6e17a8a "if_load", classname=<value optimized out>, pagepaths=0x806d031 "", creparams=0xbfc280a4,     template=0x80d4970) at do_rrd.c:404
#10 0x08057a26 in do_devmon_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca", testname=0xb6e17a8a "if_load", classname=0xb6e17abe "uhn/uhnnetwork",  pagepaths=0x806d031 "", msg=
    0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18 2010", tstamp=1282049718) at rrd/do_devmon.c:111
#11 0x08058bf6 in update_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca", testname=0xb6e17a8a "if_load", msg=0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18 2010", tstamp=
    1282049718, sender=0xb6e17a72 "127.0.0.1", ldef=0x809e490, classname=0xb6e17abe "uhn/uhnnetwork", pagepaths=0x806d031 "") at do_rrd.c:660
#12 0x0804a906 in main (argc=2, argv=0xbfc2b444) at hobbitd_rrd.c:366

list Matthew Epp · Fri, 27 Aug 2010 13:03:04 -0400 ·

Is there an open issue where this is still occurring? I am trying to monitor ldap servers with only 
port 636 open, and although the port is open (confirmed via telnet) and ldapsearches from the 
command line work, bbtest-net fails to connect even if port 636 is specified as part of the URI.

I am monitoring other servers for ldaps where both port 389 and 636 are open, by the way.

list Buchan Milne · Mon, 6 Sep 2010 16:31:37 +0100 ·

▸ quoted from Geoff Hallford

On Tuesday, 17 August 2010 14:24:15 Geoff Hallford wrote:

Hi All,

Hopefully someone can help with this issue. hobbitd_rrd keeps crashing and
popping up as red on my xymon installation. I am running 4.3.0-0 beta 2.
Here is the dump of the core file:


It looks like the attached patch fixes this. Can you test it and confirm?

▸ quoted from Olivier Beau

xymon at xymon:~/server> gdb bin/hobbitd_rrd tmp/core
GNU gdb (GDB) SUSE (7.1-3.12)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html

This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>;...
Reading symbols from /home/xymon/server/bin/hobbitd_rrd...done.
[New Thread 8252]
Core was generated by `hobbitd_rrd --rrddir=/home/xymon/data/rrd'.
Program terminated with signal 6, Aborted.
#0  0xffffe424 in __kernel_vsyscall ()

(gdb) bt
#0  0xffffe424 in __kernel_vsyscall ()
#1  0xb75937ff in raise () from /lib/libc.so.6
#2  0xb7595140 in abort () from /lib/libc.so.6
#3  0x080666d3 in sigsegv_handler (signum=11) at sig.c:57
#4  <signal handler called>
#5  0xb75de4a3 in strlen () from /lib/libc.so.6
#6  0xb75de1a6 in strdup () from /lib/libc.so.6
#7  0xb777ed16 in rrd_update () from /usr/lib/librrd.so.4
#8  0x0804c217 in flush_cached_updates (cacheitem=0x80d4030, newdata=<value
optimized out>) at do_rrd.c:225
#9  0x0804d2dc in create_and_update_rrd (hostname=<value optimized out>,
testname=0xb6e17a8a "if_load", classname=<value optimized out>,
pagepaths=0x806d031 "", creparams=0xbfc280a4,
    template=0x80d4970) at do_rrd.c:404
#10 0x08057a26 in do_devmon_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", classname=0xb6e17abe "uhn/uhnnetwork",
pagepaths=0x806d031 "", msg=
    0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18
2010", tstamp=1282049718) at rrd/do_devmon.c:111
#11 0x08058bf6 in update_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", msg=0xb6e17acd "status VPN04,uhn,ca.if_load
green Tue Aug 17 08:55:18 2010", tstamp=
    1282049718, sender=0xb6e17a72 "127.0.0.1", ldef=0x809e490,
classname=0xb6e17abe "uhn/uhnnetwork", pagepaths=0x806d031 "") at
do_rrd.c:660
#12 0x0804a906 in main (argc=2, argv=0xbfc2b444) at hobbitd_rrd.c:366

Regards,
Buchan

list Mario Andre · Thu, 9 Sep 2010 15:53:50 -0300 ·

Hi Buchan,

I'm running 4.3.0 but I think my revision is different because I could not
patch do_devmon.c , I've searched the trunk and branch files but I haven't
found the revision 6330 described into the patch file
--- hobbitd/rrd/do_devmon.c     (revision 6330).
Can you help?


Thanks in advance,

Mario.

▸ quoted from Buchan Milne



On Mon, Sep 6, 2010 at 12:31 PM, Buchan Milne <user-9b139aff4dec@xymon.invalid>wrote:

On Tuesday, 17 August 2010 14:24:15 Geoff Hallford wrote:

Hi All,

Hopefully someone can help with this issue. hobbitd_rrd keeps crashing
and
popping up as red on my xymon installation. I am running 4.3.0-0 beta 2.
Here is the dump of the core file:


It looks like the attached patch fixes this. Can you test it and confirm?

xymon at xymon:~/server> gdb bin/hobbitd_rrd tmp/core
GNU gdb (GDB) SUSE (7.1-3.12)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html

This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
and "show warranty" for details.
This GDB was configured as "i586-suse-linux".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>;...
Reading symbols from /home/xymon/server/bin/hobbitd_rrd...done.
[New Thread 8252]
Core was generated by `hobbitd_rrd --rrddir=/home/xymon/data/rrd'.
Program terminated with signal 6, Aborted.
#0  0xffffe424 in __kernel_vsyscall ()

(gdb) bt
#0  0xffffe424 in __kernel_vsyscall ()
#1  0xb75937ff in raise () from /lib/libc.so.6
#2  0xb7595140 in abort () from /lib/libc.so.6
#3  0x080666d3 in sigsegv_handler (signum=11) at sig.c:57
#4  <signal handler called>
#5  0xb75de4a3 in strlen () from /lib/libc.so.6
#6  0xb75de1a6 in strdup () from /lib/libc.so.6
#7  0xb777ed16 in rrd_update () from /usr/lib/librrd.so.4
#8  0x0804c217 in flush_cached_updates (cacheitem=0x80d4030,
newdata=<value
optimized out>) at do_rrd.c:225
#9  0x0804d2dc in create_and_update_rrd (hostname=<value optimized out>,
testname=0xb6e17a8a "if_load", classname=<value optimized out>,
pagepaths=0x806d031 "", creparams=0xbfc280a4,
    template=0x80d4970) at do_rrd.c:404
#10 0x08057a26 in do_devmon_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", classname=0xb6e17abe "uhn/uhnnetwork",
pagepaths=0x806d031 "", msg=
    0xb6e17acd "status VPN04,uhn,ca.if_load green Tue Aug 17 08:55:18
2010", tstamp=1282049718) at rrd/do_devmon.c:111
#11 0x08058bf6 in update_rrd (hostname=0xb6e17a7d "VPN04.uhn.ca",
testname=0xb6e17a8a "if_load", msg=0xb6e17acd "status

VPN04,uhn,ca.if_load

green Tue Aug 17 08:55:18 2010", tstamp=
    1282049718, sender=0xb6e17a72 "127.0.0.1", ldef=0x809e490,
classname=0xb6e17abe "uhn/uhnnetwork", pagepaths=0x806d031 "") at
do_rrd.c:660
#12 0x0804a906 in main (argc=2, argv=0xbfc2b444) at hobbitd_rrd.c:366

Regards,
Buchan

hobbitd_rrd crashing 🔗 link

hobbitd_rrd crashing