Xymon Mailing List Archive search

I'm getting the error "could not lock RRD"

20 messages in this thread

list Robin Wood · Fri, 22 Jun 2007 19:27:27 +0100 ·
Hi
I've just installed hobbit 4.2.0 on an archlinux box with rrdtool
version 1.2.23-1. Looking at the logs I'm getting the following error
every 30 seconds or so as it tries (I assume) to create the graphs:

2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from 192.168.0.2:
could not lock RRD

I've googled and searched the archives but can't find any other
mention of this error. Can anyone suggest a solution?

Thanks

Robin
list Henrik Størner · Fri, 22 Jun 2007 21:35:38 +0200 ·
quoted from Robin Wood
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from 192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik
list Robin Wood · Fri, 22 Jun 2007 21:59:28 +0100 ·
Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin
quoted from Henrik Størner

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from 192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Dean Casey · Sat, 23 Jun 2007 01:08:23 -0400 ·
I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey
quoted from Robin Wood


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Robin Wood · Sat, 23 Jun 2007 17:52:33 +0100 ·
I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin
quoted from Dean Casey

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Dean Casey · Sat, 23 Jun 2007 23:56:13 -0400 ·
Rrdtool by itself is not sufficient for all the libraries hobbit needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running "make" and
"make install". The "make clean" command is important.
quoted from Robin Wood

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Robin Wood · Sun, 24 Jun 2007 13:09:46 +0100 ·
Hi
What I should have added is that I am seeing graphs but with no graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll let
you know how it gets on.

Robin
quoted from Dean Casey

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running "make" and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Robin Wood · Sun, 24 Jun 2007 13:22:30 +0100 ·
Well, moving the log directory to the local disk stopped the error
messages but I'm still getting empty graphs.

Dean, the requirements show PCRE, RRDtool, libpng, OpenSSL and
OpenLDAP libraries. I've got all of those:

(from ./configure)

Checking for RRDtool ...
test-rrd.c: In function 'main':
test-rrd.c:30: error: too few arguments to function 'rrd_graph'
make: *** [test-compile] Error 1
Not RRDtool 1.0.x, checking for 1.2.x
Found RRDtool include files in /usr/include
Found RRDtool libraries in /usr/lib
Linking RRD with PNG library: -L/usr/lib -lpng


Checking for PCRE ...
Found PCRE include files in /usr/include
Found PCRE libraries in /usr/lib


Checking for OpenSSL ...
Found OpenSSL include files in /usr/include
Found OpenSSL libraries in /usr/lib

Any more ideas?

Robin
quoted from Robin Wood

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Hi
What I should have added is that I am seeing graphs but with no graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll let
you know how it gets on.

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running "make" and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Robin Wood · Sun, 24 Jun 2007 20:58:38 +0100 ·
Got it working! I moved the data directory to the local disk and
deleted the contents. After a while it all started working.

rrd obviously doesn't like nfs shares.
quoted from Robin Wood

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Well, moving the log directory to the local disk stopped the error
messages but I'm still getting empty graphs.

Dean, the requirements show PCRE, RRDtool, libpng, OpenSSL and
OpenLDAP libraries. I've got all of those:

(from ./configure)

Checking for RRDtool ...
test-rrd.c: In function 'main':
test-rrd.c:30: error: too few arguments to function 'rrd_graph'
make: *** [test-compile] Error 1
Not RRDtool 1.0.x, checking for 1.2.x
Found RRDtool include files in /usr/include
Found RRDtool libraries in /usr/lib
Linking RRD with PNG library: -L/usr/lib -lpng


Checking for PCRE ...
Found PCRE include files in /usr/include
Found PCRE libraries in /usr/lib


Checking for OpenSSL ...
Found OpenSSL include files in /usr/include
Found OpenSSL libraries in /usr/lib

Any more ideas?

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Hi
What I should have added is that I am seeing graphs but with no graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll let
you know how it gets on.

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running "make" and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Dean Casey · Sun, 24 Jun 2007 16:01:23 -0400 ·
Did you run "make clean" before recompiling? What OS are you running the
hobbit server on?

Dean Casey

P A T H F I R E

Email:   user-99832ab50ffd@xymon.invalid

Office:   XXX XXX XXXX 
quoted from Robin Wood

-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Sunday, June 24, 2007 8:23 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Well, moving the log directory to the local disk stopped the error
messages but I'm still getting empty graphs.

Dean, the requirements show PCRE, RRDtool, libpng, OpenSSL and
OpenLDAP libraries. I've got all of those:

(from ./configure)

Checking for RRDtool ...
test-rrd.c: In function 'main':
test-rrd.c:30: error: too few arguments to function 'rrd_graph'
make: *** [test-compile] Error 1
Not RRDtool 1.0.x, checking for 1.2.x
Found RRDtool include files in /usr/include
Found RRDtool libraries in /usr/lib
Linking RRD with PNG library: -L/usr/lib -lpng


Checking for PCRE ...
Found PCRE include files in /usr/include
Found PCRE libraries in /usr/lib


Checking for OpenSSL ...
Found OpenSSL include files in /usr/include
Found OpenSSL libraries in /usr/lib

Any more ideas?

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Hi
What I should have added is that I am seeing graphs but with no graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll let
you know how it gets on.

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit
needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running "make"
and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries,
or
data files had incorrect permissions or were missing
(unavailable).
Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory
to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea
what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Dean Casey · Sun, 24 Jun 2007 16:04:19 -0400 ·
I am running my rrd files on an NFS share, having no problems. Have also
ran several hobbit servers with the application binaries housed on NFS
mounts; the app binaries & rrd files on NFS mounts; and just the rrd
files on NFS mounts. Have been running Hobbit server with both the app
binaries and rrd files on an NFS mount, for more than a year now. Unless
there are some NFS performance issues on your network, housing those
files on an NFS mount isn't the problem. 
quoted from Dean Casey

Dean Casey 


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Sunday, June 24, 2007 3:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Got it working! I moved the data directory to the local disk and
deleted the contents. After a while it all started working.

rrd obviously doesn't like nfs shares.

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Well, moving the log directory to the local disk stopped the error
messages but I'm still getting empty graphs.

Dean, the requirements show PCRE, RRDtool, libpng, OpenSSL and
OpenLDAP libraries. I've got all of those:

(from ./configure)

Checking for RRDtool ...
test-rrd.c: In function 'main':
test-rrd.c:30: error: too few arguments to function 'rrd_graph'
make: *** [test-compile] Error 1
Not RRDtool 1.0.x, checking for 1.2.x
Found RRDtool include files in /usr/include
Found RRDtool libraries in /usr/lib
Linking RRD with PNG library: -L/usr/lib -lpng


Checking for PCRE ...
Found PCRE include files in /usr/include
Found PCRE libraries in /usr/lib


Checking for OpenSSL ...
Found OpenSSL include files in /usr/include
Found OpenSSL libraries in /usr/lib

Any more ideas?

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Hi
What I should have added is that I am seeing graphs but with no
graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll
let
you know how it gets on.

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit
needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running
"make" and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and
tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll
check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries,
binaries, or
data files had incorrect permissions or were missing
(unavailable).
Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory
to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no
idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS
filesystem?
Perhaps there's some issue with locking on networked
filsystems.


Regards,
Henrik

list Robin Wood · Mon, 25 Jun 2007 08:32:09 +0100 ·
quoted from Dean Casey
On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Did you run "make clean" before recompiling? What OS are you running the
hobbit server on?
I didn't recompile, just moved the rrd data file off the nfs share to
a local disk.

I'm running archlinux with a  2.6.19-beyond  kernel

Robin
quoted from Dean Casey

Dean Casey

P A T H F I R E

Email:   user-99832ab50ffd@xymon.invalid

Office:   XXX XXX XXXX

-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Sunday, June 24, 2007 8:23 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Well, moving the log directory to the local disk stopped the error
messages but I'm still getting empty graphs.

Dean, the requirements show PCRE, RRDtool, libpng, OpenSSL and
OpenLDAP libraries. I've got all of those:

(from ./configure)

Checking for RRDtool ...
test-rrd.c: In function 'main':
test-rrd.c:30: error: too few arguments to function 'rrd_graph'
make: *** [test-compile] Error 1
Not RRDtool 1.0.x, checking for 1.2.x
Found RRDtool include files in /usr/include
Found RRDtool libraries in /usr/lib
Linking RRD with PNG library: -L/usr/lib -lpng


Checking for PCRE ...
Found PCRE include files in /usr/include
Found PCRE libraries in /usr/lib


Checking for OpenSSL ...
Found OpenSSL include files in /usr/include
Found OpenSSL libraries in /usr/lib

Any more ideas?

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Hi
What I should have added is that I am seeing graphs but with no graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll let
you know how it gets on.

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit
needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running "make"
and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries, binaries,
or
data files had incorrect permissions or were missing
(unavailable).
Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory
to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea
what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

list Robin Wood · Mon, 25 Jun 2007 08:34:13 +0100 ·
Well, something fixed it and I'd rather not break again it while
fiddling around to try to find out what it was!

The nfs config is straight out of the box, nothing special and
everything else runs ok. Maybe it was something corrupt in the data
files and clearing them after moving the directory cleared the
problem.
quoted from Robin Wood

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I am running my rrd files on an NFS share, having no problems. Have also
ran several hobbit servers with the application binaries housed on NFS
mounts; the app binaries & rrd files on NFS mounts; and just the rrd
files on NFS mounts. Have been running Hobbit server with both the app
binaries and rrd files on an NFS mount, for more than a year now. Unless
there are some NFS performance issues on your network, housing those
files on an NFS mount isn't the problem.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Sunday, June 24, 2007 3:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Got it working! I moved the data directory to the local disk and
deleted the contents. After a while it all started working.

rrd obviously doesn't like nfs shares.

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Well, moving the log directory to the local disk stopped the error
messages but I'm still getting empty graphs.

Dean, the requirements show PCRE, RRDtool, libpng, OpenSSL and
OpenLDAP libraries. I've got all of those:

(from ./configure)

Checking for RRDtool ...
test-rrd.c: In function 'main':
test-rrd.c:30: error: too few arguments to function 'rrd_graph'
make: *** [test-compile] Error 1
Not RRDtool 1.0.x, checking for 1.2.x
Found RRDtool include files in /usr/include
Found RRDtool libraries in /usr/lib
Linking RRD with PNG library: -L/usr/lib -lpng


Checking for PCRE ...
Found PCRE include files in /usr/include
Found PCRE libraries in /usr/lib


Checking for OpenSSL ...
Found OpenSSL include files in /usr/include
Found OpenSSL libraries in /usr/lib

Any more ideas?

Robin

On 6/24/07, Robin Wood <user-c74ace4d3caf@xymon.invalid> wrote:
Hi
What I should have added is that I am seeing graphs but with no
graph
lines and no numeric data in them. The filesystem graph for example,
shows all my mount points but then where the numbers are supposed to
be it is showing nan.

I'm trying moving the data/rrd directory to a local disk now, I'll
let
you know how it gets on.

Robin

On 6/24/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Rrdtool by itself is not sufficient for all the libraries hobbit
needs.
Please check the list of installed libraries against the hobbit
pre-requisites & install any missing libraries. Then, when you
re-compile hobbit afterward, run "make clean" before running
"make" and
"make install". The "make clean" command is important.

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Saturday, June 23, 2007 12:53 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

I built hobbit from source and initially it complained that the
libraries weren't there so I installed the rrdtool package and
tried
again. This time it built so I assume that it had all it needed.

If you can let me know which files need what permissions I'll
check
when I check the nfs share suggestion later.

Robin

On 6/23/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
I've seen this rrd error in the past when rrd libraries,
binaries, or
data files had incorrect permissions or were missing
(unavailable).
Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory
to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no
idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS
filesystem?
Perhaps there's some issue with locking on networked
filsystems.


Regards,
Henrik

list Henrik Størner · Mon, 25 Jun 2007 10:46:17 +0200 ·
quoted from Robin Wood
On Mon, Jun 25, 2007 at 08:34:13AM +0100, Robin Wood wrote:
Well, something fixed it and I'd rather not break again it while
fiddling around to try to find out what it was!
You could try and run "rpcinfo -p" and see if there's an "nlockmgr"
service registered - this is what normally handles NFS locking requests.


Regards,
Henrik
list Seymour Brown · Mon, 25 Jun 2007 09:18:49 -0500 ·
Indeed, we get this when something in our MRTG process gets an error,
and the rrd data files then become owned by root instead of hobbit. We
also get it if we start hobbit as root instead of hobbit. I think the
lock is a red herring - it simply could not open the file.

My fix has been to do cd /var/lib/hobbit/rrd (or wherever you keep your
rrd data) and then chown hobbit * -R 

As far as the MRTG causing it, the MRTG logs generally point the way. 

The key seems to be to configure and operate hobbit as the hobbit user.

=Seymour=

Seymour J. Brown
Network Analyst
CCNA, CFS, CWNA, Network+
West Jefferson Medical Center
XXXX Medical Center Blvd.
Marrero, LA XXXXX
XXX-XXX-XXXX
quoted from Dean Casey
 

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid] 
Sent: Saturday, June 23, 2007 12:08 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. West Jefferson Medical Center, 1101 Medical Center Blvd., Marrero, USA, www.wjmc.org.
list Dean Casey · Mon, 25 Jun 2007 10:43:53 -0400 ·
Seymour makes a good point. I also get similar errors when running
Hobbit as root... doing that often changes file permissions and "breaks"
Hobbit afterward. 

The solution was to set up a very simple startup file that looks
something like this (on RedHat, other Linuxes will vary but should be
pretty close), based on the old BB startup script:

###
###
#!/bin/bash
#
# hobbit-server   This shell script takes care of starting and stopping
#                 hobbit monitoring server.
#
# chkconfig: - 99 45
# description: Hobbit monitoring server is\
# used to monitor Pathfire's systems.
# probe: true

# Source function library.
. /etc/rc.d/init.d/functions

# Source networking configuration.
. /etc/sysconfig/network

# Check that networking is up.
[ "${NETWORKING}" = "no" ] && exit 0


PATH=$PATH:/bin:/usr/bin                # FOR su
BBHOME=/home/hobbit
BBUSER=hobbit

case "$1" in
start)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh start"
        ;;
restart)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh restart"
        ;;
stop)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh stop"
        ;;
status)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh status"
        ;;
*)
        echo "Usage: $0 {start|stop|restart|status}"
        exit 1
        ;;
esac

exit 0
###
###

I then set permissions on the startup file so:
-rwxr-xr-x   1 root root   954 Jun 19 11:49 hobbit-server

I then ran:
"chkconfig --345 hobbit-server on"


Now, on RedHat, I can run hobbit server without worrying about "su -
hobbit" first, using commands:
"service hobbit-server (start|stop|restart|status)"


You can do something similar for the hobbit client on RedHat or other
Linux variants. Solaris would use a truncated version of this startup
script.

Dean Casey
quoted from Seymour Brown


-----Original Message-----
From: Brown, Seymour [mailto:user-334fe7d1ea0d@xymon.invalid] 
Sent: Monday, June 25, 2007 10:19 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Indeed, we get this when something in our MRTG process gets an error,
and the rrd data files then become owned by root instead of hobbit. We
also get it if we start hobbit as root instead of hobbit. I think the
lock is a red herring - it simply could not open the file.

My fix has been to do cd /var/lib/hobbit/rrd (or wherever you keep your
rrd data) and then chown hobbit * -R 

As far as the MRTG causing it, the MRTG logs generally point the way. 

The key seems to be to configure and operate hobbit as the hobbit user.

=Seymour=

Seymour J. Brown
Network Analyst
CCNA, CFS, CWNA, Network+
West Jefferson Medical Center
XXXX Medical Center Blvd.
Marrero, LA XXXXX
XXX-XXX-XXXX
 

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid] 
Sent: Saturday, June 23, 2007 12:08 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

This message contains confidential information and is intended only for
the individual named. If you are not the named addressee you should not
disseminate, distribute or copy this e-mail. Please notify the sender
immediately by e-mail if you have received this e-mail by mistake and
delete this e-mail from your system. E-mail transmission cannot be
guaranteed to be secure or error-free as information could be
intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
contain viruses. The sender therefore does not accept liability for any
errors or omissions in the contents of this message, which arise as a
result of e-mail transmission. If verification is required please
request a hard-copy version. West Jefferson Medical Center, 1101 Medical
Center Blvd., Marrero, USA, www.wjmc.org.
list Galen Johnson · Mon, 25 Jun 2007 10:53:41 -0400 ·
I thought the hobbit startup script already checked for being run as root (I know if I try to run as root it tells me to run it as the hobbit user)...unless it was configured to do so at compile time.  NFS generally can't handle being updated as root unless you explicitly configure the server to allow it in the mount config (this varies from system to system so check out the manpage).  This would explain the behavior you're seeing when running hobbiut as root.

=G= 
quoted from Dean Casey

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid] 
Sent: Monday, June 25, 2007 10:44 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Seymour makes a good point. I also get similar errors when running Hobbit as root... doing that often changes file permissions and "breaks"
Hobbit afterward. 

The solution was to set up a very simple startup file that looks something like this (on RedHat, other Linuxes will vary but should be pretty close), based on the old BB startup script:

###
###
#!/bin/bash
#
# hobbit-server   This shell script takes care of starting and stopping
#                 hobbit monitoring server.
#
# chkconfig: - 99 45
# description: Hobbit monitoring server is\ # used to monitor Pathfire's systems.
# probe: true

# Source function library.
. /etc/rc.d/init.d/functions

# Source networking configuration.
. /etc/sysconfig/network

# Check that networking is up.
[ "${NETWORKING}" = "no" ] && exit 0


PATH=$PATH:/bin:/usr/bin                # FOR su
BBHOME=/home/hobbit
BBUSER=hobbit

case "$1" in
start)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh start"
        ;;
restart)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh restart"
        ;;
stop)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh stop"
        ;;
status)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh status"
        ;;
*)
        echo "Usage: $0 {start|stop|restart|status}"
        exit 1
        ;;
esac

exit 0
###
###

I then set permissions on the startup file so:
-rwxr-xr-x   1 root root   954 Jun 19 11:49 hobbit-server

I then ran:
"chkconfig --345 hobbit-server on"


Now, on RedHat, I can run hobbit server without worrying about "su - hobbit" first, using commands:
"service hobbit-server (start|stop|restart|status)"


You can do something similar for the hobbit client on RedHat or other Linux variants. Solaris would use a truncated version of this startup script.

Dean Casey


-----Original Message-----
From: Brown, Seymour [mailto:user-334fe7d1ea0d@xymon.invalid]
Sent: Monday, June 25, 2007 10:19 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Indeed, we get this when something in our MRTG process gets an error, and the rrd data files then become owned by root instead of hobbit. We also get it if we start hobbit as root instead of hobbit. I think the lock is a red herring - it simply could not open the file.

My fix has been to do cd /var/lib/hobbit/rrd (or wherever you keep your rrd data) and then chown hobbit * -R 

As far as the MRTG causing it, the MRTG logs generally point the way. 

The key seems to be to configure and operate hobbit as the hobbit user.

=Seymour=

Seymour J. Brown
Network Analyst
CCNA, CFS, CWNA, Network+
West Jefferson Medical Center
XXXX Medical Center Blvd.
Marrero, LA XXXXX
XXX-XXX-XXXX
 

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Saturday, June 23, 2007 12:08 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

I've seen this rrd error in the past when rrd libraries, binaries, or data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating 
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what 
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. West Jefferson Medical Center, 1101 Medical Center Blvd., Marrero, USA, www.wjmc.org.
list Robin Wood · Mon, 25 Jun 2007 17:59:25 +0100 ·
Hobbit definitely wasn't being ran as root and the rrd directories
were created either by hobbit or by the install script. The version
I'm running at the moment is on a test system, when I roll it out to
the new live box I'll see if it happens again.

Robin
quoted from Galen Johnson

On 6/25/07, Galen Johnson <user-87f955643e3d@xymon.invalid> wrote:
I thought the hobbit startup script already checked for being run as root (I know if I try to run as root it tells me to run it as the hobbit user)...unless it was configured to do so at compile time.  NFS generally can't handle being updated as root unless you explicitly configure the server to allow it in the mount config (this varies from system to system so check out the manpage).  This would explain the behavior you're seeing when running hobbiut as root.

=G=

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Monday, June 25, 2007 10:44 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Seymour makes a good point. I also get similar errors when running Hobbit as root... doing that often changes file permissions and "breaks"
Hobbit afterward.

The solution was to set up a very simple startup file that looks something like this (on RedHat, other Linuxes will vary but should be pretty close), based on the old BB startup script:

###
###
#!/bin/bash
#
# hobbit-server   This shell script takes care of starting and stopping
#                 hobbit monitoring server.
#
# chkconfig: - 99 45
# description: Hobbit monitoring server is\ # used to monitor Pathfire's systems.
# probe: true

# Source function library.
. /etc/rc.d/init.d/functions

# Source networking configuration.
. /etc/sysconfig/network

# Check that networking is up.
[ "${NETWORKING}" = "no" ] && exit 0


PATH=$PATH:/bin:/usr/bin                # FOR su
BBHOME=/home/hobbit
BBUSER=hobbit

case "$1" in
start)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh start"
        ;;
restart)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh restart"
        ;;
stop)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh stop"
        ;;
status)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh status"
        ;;
*)
        echo "Usage: $0 {start|stop|restart|status}"
        exit 1
        ;;
esac

exit 0
###
###

I then set permissions on the startup file so:
-rwxr-xr-x   1 root root   954 Jun 19 11:49 hobbit-server

I then ran:
"chkconfig --345 hobbit-server on"


Now, on RedHat, I can run hobbit server without worrying about "su - hobbit" first, using commands:
"service hobbit-server (start|stop|restart|status)"


You can do something similar for the hobbit client on RedHat or other Linux variants. Solaris would use a truncated version of this startup script.

Dean Casey


-----Original Message-----
From: Brown, Seymour [mailto:user-334fe7d1ea0d@xymon.invalid]
Sent: Monday, June 25, 2007 10:19 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Indeed, we get this when something in our MRTG process gets an error, and the rrd data files then become owned by root instead of hobbit. We also get it if we start hobbit as root instead of hobbit. I think the lock is a red herring - it simply could not open the file.

My fix has been to do cd /var/lib/hobbit/rrd (or wherever you keep your rrd data) and then chown hobbit * -R

As far as the MRTG causing it, the MRTG logs generally point the way.

The key seems to be to configure and operate hobbit as the hobbit user.

=Seymour=

Seymour J. Brown
Network Analyst
CCNA, CFS, CWNA, Network+
West Jefferson Medical Center
XXXX Medical Center Blvd.
Marrero, LA XXXXX
XXX-XXX-XXXX


-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Saturday, June 23, 2007 12:08 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

I've seen this rrd error in the past when rrd libraries, binaries, or data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. West Jefferson Medical Center, 1101 Medical Center Blvd., Marrero, USA, www.wjmc.org.

list Dean Casey · Mon, 25 Jun 2007 17:01:53 -0400 ·
Possibly the NFS server was set to use LDAP or some other authentication
method? Dose the NFS serer have a same uid/gid user account as the
hobbit account on the monitoring server? Is the NFS set up to allow
"777" and root-level permissions for the monitoring server (when
accessing the NFS share)? This is starting to sound more and more like
an NFS authentication conflict. 

Dean
quoted from Robin Wood


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid] 
Sent: Monday, June 25, 2007 12:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hobbit definitely wasn't being ran as root and the rrd directories
were created either by hobbit or by the install script. The version
I'm running at the moment is on a test system, when I roll it out to
the new live box I'll see if it happens again.

Robin

On 6/25/07, Galen Johnson <user-87f955643e3d@xymon.invalid> wrote:
I thought the hobbit startup script already checked for being run as
root (I know if I try to run as root it tells me to run it as the hobbit
user)...unless it was configured to do so at compile time.  NFS
generally can't handle being updated as root unless you explicitly
configure the server to allow it in the mount config (this varies from
system to system so check out the manpage).  This would explain the
behavior you're seeing when running hobbiut as root.

=G=

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Monday, June 25, 2007 10:44 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Seymour makes a good point. I also get similar errors when running
Hobbit as root... doing that often changes file permissions and "breaks"
Hobbit afterward.

The solution was to set up a very simple startup file that looks
something like this (on RedHat, other Linuxes will vary but should be
pretty close), based on the old BB startup script:

###
###
#!/bin/bash
#
# hobbit-server   This shell script takes care of starting and
stopping
#                 hobbit monitoring server.
#
# chkconfig: - 99 45
# description: Hobbit monitoring server is\ # used to monitor
Pathfire's systems.
# probe: true

# Source function library.
. /etc/rc.d/init.d/functions

# Source networking configuration.
. /etc/sysconfig/network

# Check that networking is up.
[ "${NETWORKING}" = "no" ] && exit 0


PATH=$PATH:/bin:/usr/bin                # FOR su
BBHOME=/home/hobbit
BBUSER=hobbit

case "$1" in
start)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh start"
        ;;
restart)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh restart"
        ;;
stop)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh stop"
        ;;
status)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh status"
        ;;
*)
        echo "Usage: $0 {start|stop|restart|status}"
        exit 1
        ;;
esac

exit 0
###
###

I then set permissions on the startup file so:
-rwxr-xr-x   1 root root   954 Jun 19 11:49 hobbit-server

I then ran:
"chkconfig --345 hobbit-server on"


Now, on RedHat, I can run hobbit server without worrying about "su -
hobbit" first, using commands:
"service hobbit-server (start|stop|restart|status)"


You can do something similar for the hobbit client on RedHat or other
Linux variants. Solaris would use a truncated version of this startup
script.
Dean Casey


-----Original Message-----
From: Brown, Seymour [mailto:user-334fe7d1ea0d@xymon.invalid]
Sent: Monday, June 25, 2007 10:19 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Indeed, we get this when something in our MRTG process gets an error,
and the rrd data files then become owned by root instead of hobbit. We
also get it if we start hobbit as root instead of hobbit. I think the
lock is a red herring - it simply could not open the file.

My fix has been to do cd /var/lib/hobbit/rrd (or wherever you keep
your rrd data) and then chown hobbit * -R

As far as the MRTG causing it, the MRTG logs generally point the way.

The key seems to be to configure and operate hobbit as the hobbit
user.

=Seymour=

Seymour J. Brown
Network Analyst
CCNA, CFS, CWNA, Network+
West Jefferson Medical Center
XXXX Medical Center Blvd.
Marrero, LA XXXXX
XXX-XXX-XXXX


-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Saturday, June 23, 2007 12:08 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

This message contains confidential information and is intended only
for the individual named. If you are not the named addressee you should
not disseminate, distribute or copy this e-mail. Please notify the
sender immediately by e-mail if you have received this e-mail by mistake
and delete this e-mail from your system. E-mail transmission cannot be
guaranteed to be secure or error-free as information could be
intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
contain viruses. The sender therefore does not accept liability for any
errors or omissions in the contents of this message, which arise as a
result of e-mail transmission. If verification is required please
request a hard-copy version. West Jefferson Medical Center, 1101 Medical
Center Blvd., Marrero, USA, www.wjmc.org.
list Robin Wood · Tue, 26 Jun 2007 10:09:07 +0100 ·
NFS is using normal user authentication, nothing special. Both
machines have hobbit as a user with the same uid.

I've just put it back onto the nfs share and it is complaining again.

The rrd directory is there and set at 777. Something, I assume rrd,
created all the files in the directory so it has write access. After
it created them all I've set them all to 777 so anyone can do anything
with them, still getting errors.

ls -alR
.:
total 1
drwxrwxrwx  5 hobbit users 120 2007-06-26 09:59 .
drwxr-xr-x 10 hobbit users 240 2007-06-26 09:50 ..
drwxrwxrwx  2 hobbit users 536 2007-06-26 10:00 ra

./ra:
total 701
drwxrwxrwx 2 hobbit users    536 2007-06-26 10:00 .
drwxrwxrwx 5 hobbit users    120 2007-06-26 09:59 ..
-rwxrwxrwx 1 hobbit users  19552 2007-06-26 09:58 bbgen.rrd
-rwxrwxrwx 1 hobbit users  19552 2007-06-26 09:57 clock.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:57 disk,root.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:58 disk,var,cache,pacman.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:58 disk,var,iso.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:59 disk,var,vmware.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:57 ifstat.eth0.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:57 ifstat.vmnet1.rrd
-rwxrwxrwx 1 hobbit users  38536 2007-06-26 09:58 ifstat.vmnet8.rrd
-rwxrwxrwx 1 hobbit users 304312 2007-06-26 09:56 netstat.rrd
-rwxrwxrwx 1 hobbit users  19552 2007-06-26 09:56 procs.rrd
-rw-r--r-- 1 hobbit users  19552 2007-06-26 10:00 tcp.bbd.rrd
-rwxrwxrwx 1 hobbit users  19552 2007-06-26 10:00 tcp.conn.rrd
-rwxrwxrwx 1 hobbit users  19552 2007-06-26 09:56 users.rrd

An example error message:

2007-06-26 10:00:31 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/rastlin/tcp.conn.rrd from
192.168.0.2: could not lock RRD

Where would the lock file be created? Is that in a different directory?

Robin
quoted from Dean Casey

On 6/25/07, Dean Casey <user-99832ab50ffd@xymon.invalid> wrote:
Possibly the NFS server was set to use LDAP or some other authentication
method? Dose the NFS serer have a same uid/gid user account as the
hobbit account on the monitoring server? Is the NFS set up to allow
"777" and root-level permissions for the monitoring server (when
accessing the NFS share)? This is starting to sound more and more like
an NFS authentication conflict.

Dean


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Monday, June 25, 2007 12:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hobbit definitely wasn't being ran as root and the rrd directories
were created either by hobbit or by the install script. The version
I'm running at the moment is on a test system, when I roll it out to
the new live box I'll see if it happens again.

Robin

On 6/25/07, Galen Johnson <user-87f955643e3d@xymon.invalid> wrote:
I thought the hobbit startup script already checked for being run as
root (I know if I try to run as root it tells me to run it as the hobbit
user)...unless it was configured to do so at compile time.  NFS
generally can't handle being updated as root unless you explicitly
configure the server to allow it in the mount config (this varies from
system to system so check out the manpage).  This would explain the
behavior you're seeing when running hobbiut as root.

=G=

-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Monday, June 25, 2007 10:44 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Seymour makes a good point. I also get similar errors when running
Hobbit as root... doing that often changes file permissions and "breaks"
Hobbit afterward.

The solution was to set up a very simple startup file that looks
something like this (on RedHat, other Linuxes will vary but should be
pretty close), based on the old BB startup script:

###
###
#!/bin/bash
#
# hobbit-server   This shell script takes care of starting and
stopping
#                 hobbit monitoring server.
#
# chkconfig: - 99 45
# description: Hobbit monitoring server is\ # used to monitor
Pathfire's systems.
# probe: true

# Source function library.
. /etc/rc.d/init.d/functions

# Source networking configuration.
. /etc/sysconfig/network

# Check that networking is up.
[ "${NETWORKING}" = "no" ] && exit 0


PATH=$PATH:/bin:/usr/bin                # FOR su
BBHOME=/home/hobbit
BBUSER=hobbit

case "$1" in
start)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh start"
        ;;
restart)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh restart"
        ;;
stop)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh stop"
        ;;
status)
        su - $BBUSER -c "cd $BBHOME;./server/hobbit.sh status"
        ;;
*)
        echo "Usage: $0 {start|stop|restart|status}"
        exit 1
        ;;
esac

exit 0
###
###

I then set permissions on the startup file so:
-rwxr-xr-x   1 root root   954 Jun 19 11:49 hobbit-server

I then ran:
"chkconfig --345 hobbit-server on"


Now, on RedHat, I can run hobbit server without worrying about "su -
hobbit" first, using commands:
"service hobbit-server (start|stop|restart|status)"


You can do something similar for the hobbit client on RedHat or other
Linux variants. Solaris would use a truncated version of this startup
script.
Dean Casey


-----Original Message-----
From: Brown, Seymour [mailto:user-334fe7d1ea0d@xymon.invalid]
Sent: Monday, June 25, 2007 10:19 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

Indeed, we get this when something in our MRTG process gets an error,
and the rrd data files then become owned by root instead of hobbit. We
also get it if we start hobbit as root instead of hobbit. I think the
lock is a red herring - it simply could not open the file.

My fix has been to do cd /var/lib/hobbit/rrd (or wherever you keep
your rrd data) and then chown hobbit * -R

As far as the MRTG causing it, the MRTG logs generally point the way.

The key seems to be to configure and operate hobbit as the hobbit
user.

=Seymour=

Seymour J. Brown
Network Analyst
CCNA, CFS, CWNA, Network+
West Jefferson Medical Center
XXXX Medical Center Blvd.
Marrero, LA XXXXX
XXX-XXX-XXXX


-----Original Message-----
From: Dean Casey [mailto:user-99832ab50ffd@xymon.invalid]
Sent: Saturday, June 23, 2007 12:08 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] I'm getting the error "could not lock RRD"

I've seen this rrd error in the past when rrd libraries, binaries, or
data files had incorrect permissions or were missing (unavailable).

Dean Casey


-----Original Message-----
From: Robin Wood [mailto:user-c74ace4d3caf@xymon.invalid]
Sent: Friday, June 22, 2007 4:59 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] I'm getting the error "could not lock RRD"

Hi
The directory is a nfs share. I'll try moving the data directory to a
local disk and see if that fixes it.

Robin

On 6/22/07, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
On Fri, Jun 22, 2007 at 07:27:27PM +0100, Robin Wood wrote:
2007-06-22 19:24:55 RRD error updating
/var/sites/hobbit/non-secure//data/rrd/xxx/procs.rrd from
192.168.0.2:
could not lock RRD
It's an error from the rrdtool library. I honestly have no idea what
could be causing this.

Is the /var/sites/hobbit/non-secure//data/rrd an NFS filesystem?
Perhaps there's some issue with locking on networked filsystems.


Regards,
Henrik

This message contains confidential information and is intended only
for the individual named. If you are not the named addressee you should
not disseminate, distribute or copy this e-mail. Please notify the
sender immediately by e-mail if you have received this e-mail by mistake
and delete this e-mail from your system. E-mail transmission cannot be
guaranteed to be secure or error-free as information could be
intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
contain viruses. The sender therefore does not accept liability for any
errors or omissions in the contents of this message, which arise as a
result of e-mail transmission. If verification is required please
request a hard-copy version. West Jefferson Medical Center, 1101 Medical
Center Blvd., Marrero, USA, www.wjmc.org.