Custom script, rrd file, GAUGE datatype , UNKN 🔗 link

----- Original Message ----
From: "user-762f8f482193@xymon.invalid" <user-762f8f482193@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thursday, May 29, 2008 12:34:04 AM
Subject: [hobbit] Any interest in some patches / additional code.


Hi, 
I have made some interesting (to me anyway) changes to the hobbit code at the site I am currently contracting to. They had no monitoring system at all when I started working here so installing and integrating hobbit has been an interesting exercise. 
These are after applying the allinone patch: 
1. email acknowledgement details to the user that acknowledges an alert (allows you to the forward to heldesk or other). 
2. a working but not thoroughly tested change that propogates the ticks from acknowledgements upwards so that you see ticks at the top level if everything below has been acknowledged. 
3. an additional column on the hobbit screen that lists an icon next to the server name that is a link to rdp://servername or ssh://servername so that you can click next to the server name and fire up a terminal session directly to that server. 
4. a php and perl script that creates an excel file returned to the user through the web browser outlining outages etc for a given period 
5. a module for monitoring the status of EMC/Legato Networker Backup systems (including mulitple Backup servers with many clients). 
6. a small javascript web page that displays two frames in your browser, the top one shows a summary of alerts by color and the bottom frame swaps between the front hobbit screen and the non green view on a 10 second cycle. 
7. Additionally, I found it hard to keep the config file up to date with a large number of IT staff making changes to servers and adding new servers constantly. In order to make this easier, I created a database and an application in front of this to handle adds and changes in a way that allows for verification and approval of server data. This data is then pulled automatically via a perl script that is run periodically to update the entire hobbit bb-hosts configuration. This includes the ability to auto generate pages by system owner, by location, by priority. There is also the capability to determine additional pages that a server should appear on such as by Service. 
The database contains details such as Contract No, install date model number, owner, support group etc which are displayed in a table on the info page of hobbit so that anyone can bring up a server and find details on it directly from within hobbit. 
Unfortunately, I was forced to write the application in MS Access with an Access Front End and a seperate Access Database. I would have preferred MySQL and PHP, but they are paying the bills so they get to determine the method. 
I would like to gauge interest in these changes/additions and see if anyone is interested in helping me get the code above into the main stream. In addition I would like to write a PHP / MySql version of the DB but would need some help given my time and financial constraints. 
My current employer is happy for all this code to be released back into Open Source or GPL. 


This message is intended for the addressee named and may contain confidential information. If you are not the intended recipient, please delete it and notify the sender. Views expressed in this message are those of the individual sender, and are not necessarily the views of their organisation.

On Thu, 29 May 2008 user-762f8f482193@xymon.invalid wrote:

Hi,

I have made some interesting (to me anyway) changes to the hobbit code at
the site I am currently contracting to. They had no monitoring system at
all when I started working here so installing and integrating hobbit has
been an interesting exercise.

These are after applying the allinone patch:

1. email acknowledgement details to the user that acknowledges an alert
(allows you to the forward to heldesk or other).

2. a working but not thoroughly tested change that propogates the ticks
from acknowledgements upwards so that you see ticks at the top level if
everything below has been acknowledged.

3. an additional column on the hobbit screen that lists an icon next to
the server name that is a link to rdp://servername or ssh://servername so
that you can click next to the server name and fire up a terminal session
directly to that server.

4. a php and perl script that creates an excel file returned to the user
through the web browser outlining outages etc for a given period

5. a module for monitoring the status of EMC/Legato Networker Backup
systems (including mulitple Backup servers with many clients).

6. a small javascript web page that displays two frames in your browser,
the top one shows a summary of alerts by color and the bottom frame swaps
between the front hobbit screen and the non green view on a 10 second
cycle.

7. Additionally, I found it hard to keep the config file up to date with a
large number of IT staff making changes to servers and adding new servers
constantly. In order to make this easier, I created a database and an
application in front of this to handle adds and changes in a way that
allows for verification and approval of server data. This data is then
pulled automatically via a perl script that is run periodically to update
the entire hobbit bb-hosts configuration. This includes the ability to
auto generate pages by system owner, by location, by priority. There is
also the capability to determine additional pages that a server should
appear on such as by Service.

The database contains details such as Contract No, install date model
number, owner, support group etc which are displayed in a table on the
info page of hobbit so that anyone can bring up a server and find details
on it directly from within hobbit.

Unfortunately, I was forced to write the application in MS Access with an
Access Front End and a seperate Access Database. I would have preferred
MySQL and PHP, but they are paying the bills so they get to determine the
method.

I would like to gauge interest in these changes/additions and see if
anyone is interested in helping me get the code above into the main
stream. In addition I would like to write a PHP / MySql version of the DB
but would need some help given my time and financial constraints.

My current employer is happy for all this code to be released back into
Open Source or GPL.


This message is intended for the addressee named and may contain confidential information. If you are not the intended recipient, please delete it and notify the sender. Views expressed in this message are those of the individual sender, and are not necessarily the views of their organisation.

-----Original Message-----
From: Anna Jonna Armannsdottir [mailto:user-a8cde33204f6@xymon.invalid] Sent: mercoledì 28 maggio 2008 17.23
To: Hobbit user
Subject: [hobbit] Custom script, rrd file, GAUGE datatype , UNKN

I have created a GPL Hobbit module to monitor Flex License Manager. It seems to be working and delivering data in Hobbit under the column flexlm . 
On the server, the hobbitserver.cfg file has been changed like so: TEST2RRD="cpu=...  ... flexlm=ncv"
Data is delivered in the RRD file flexlm.rrd 
The data arrives OK into the rrd file, with the correct number of used licenses in last_ds field with the default data type DERIVE. 
SO far so good, but for the graphs, the datatype should be GAUGE. 
So I added the following line to hobbitserver.cfg : NCV_flexlm="MATLAB:GAUGE" 
I have tested this a few times, being extra careful to do: ~/server/bin/bb 127.0.0.1 "drop jotunn.rhi.hi.is flexlm" as hobbit user then after stopping the server:

rm /var/lib/hobbit/rrd/jotunn.rhi.hi.is/flexlm.rrd

Start the server a minute later. 
Then the last_ds field is set to UNKN like in the following example. 
<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>
        <step> 300 </step> <!-- Seconds -->
        <lastupdate> 1211985894 </lastupdate> <!-- 2008-05-28 14:44:54 GMT -->

        <ds>
                <name> MATLAB </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 600 </minimal_heartbeat>
                <min> 0.0000000000e+00 </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> UNKN </last_ds>
                <value> 5.8800000000e+02 </value>
                <unknown_sec> 0 </unknown_sec>
        </ds>

I wonder if this has something to do with the fact that the output format from my flexlm module to Hobbit is: $AWK '{printf "%.19s : %d\n", $3, $11 }' Resulting in lines like this: MATLAB : 1 
Maybe it is the \n in the format string or maybe there should be a space after the number. 
I am stuck here. Can anybody help me out. :)
BTW: I am using Hobbit 4.2.0 with the allinone patch. 
-- 
Kindest Regards, Anna Jonna Ármannsdóttir,       %&   A: Because people read from top to bottom.
Unix System Aministration, Computing Services,   %&   Q: Why is top posting bad?
University of Iceland.

On fim, 2008-05-29 at 11:26 +0200, Morsiani, Massimo wrote:

Hi Anna,

could you please post your flexlm script to the list? Or even to
TheShire website?
Thanks in advance.


Regards.

Massimo Morsiani
Information Technology Dept. 

-- 
Kindest Regards, Anna Jonna Ármannsdóttir,       %&   A: Because people read from top to bottom.
Unix System Aministration, Computing Services,   %&   Q: Why is top posting bad?
University of Iceland.

-----Original Message-----
From: Magnus Carlebjörk [mailto:user-c92457131d08@xymon.invalid] 
Sent: 29 May 2008 09:13
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Any interest in some patches / additional code.

Hi,

I would definitely be interested in these patches. I guess some of them are 
candidates for incorporation in the main distribution and others as add-ons at 
The Shire?

Perhaps you could post a link to the patchset / files for others to test?

Regards,
--
Magnus Carlebjork
Stockholm, Sweden
+46 76 116 9008


On Thu, 29 May 2008 user-762f8f482193@xymon.invalid wrote:

Hi,

I have made some interesting (to me anyway) changes to the hobbit code at
the site I am currently contracting to. They had no monitoring system at
all when I started working here so installing and integrating hobbit has
been an interesting exercise.

These are after applying the allinone patch:

1. email acknowledgement details to the user that acknowledges an alert
(allows you to the forward to heldesk or other).

2. a working but not thoroughly tested change that propogates the ticks
from acknowledgements upwards so that you see ticks at the top level if
everything below has been acknowledged.

3. an additional column on the hobbit screen that lists an icon next to
the server name that is a link to rdp://servername or ssh://servername so
that you can click next to the server name and fire up a terminal session
directly to that server.

4. a php and perl script that creates an excel file returned to the user
through the web browser outlining outages etc for a given period

5. a module for monitoring the status of EMC/Legato Networker Backup
systems (including mulitple Backup servers with many clients).

6. a small javascript web page that displays two frames in your browser,
the top one shows a summary of alerts by color and the bottom frame swaps
between the front hobbit screen and the non green view on a 10 second
cycle.

7. Additionally, I found it hard to keep the config file up to date with a
large number of IT staff making changes to servers and adding new servers
constantly. In order to make this easier, I created a database and an
application in front of this to handle adds and changes in a way that
allows for verification and approval of server data. This data is then
pulled automatically via a perl script that is run periodically to update
the entire hobbit bb-hosts configuration. This includes the ability to
auto generate pages by system owner, by location, by priority. There is
also the capability to determine additional pages that a server should
appear on such as by Service.

The database contains details such as Contract No, install date model
number, owner, support group etc which are displayed in a table on the
info page of hobbit so that anyone can bring up a server and find details
on it directly from within hobbit.

Unfortunately, I was forced to write the application in MS Access with an
Access Front End and a seperate Access Database. I would have preferred
MySQL and PHP, but they are paying the bills so they get to determine the
method.

I would like to gauge interest in these changes/additions and see if
anyone is interested in helping me get the code above into the main
stream. In addition I would like to write a PHP / MySql version of the DB
but would need some help given my time and financial constraints.

My current employer is happy for all this code to be released back into
Open Source or GPL.


This message is intended for the addressee named and may contain confidential information. If you are not the intended recipient, please delete it and notify the sender. Views expressed in this message are those of the individual sender, and are not necessarily the views of their organisation.

On Thu, 2008-05-29 at 08:34 +1000, user-762f8f482193@xymon.invalid wrote:

7. Additionally, I found it hard to keep the config file up to date
with a large number of IT staff making changes to servers and adding
new servers constantly. 

user-290ce4e24e19@xymon.invalid> wrote:

On Thu, 2008-05-29 at 08:34 +1000, user-762f8f482193@xymon.invalid wrote:

7. Additionally, I found it hard to keep the config file up to date
with a large number of IT staff making changes to servers and adding
new servers constantly.

I have a similar requirement, revolving around network hardware.  I
currently use a mysql database to keep track of routers, firewalls, UPS,
temperature probes, load-balancers, and the like, and use a script to
auto-generate my hobbit config.

--
Daniel J McDonald, CCIE #2495, CISSP #78281, CNX
Austin Energy
http://www.austinenergy.com

-- 

Anna Jonna Armannsdottir wrote:

I have created a GPL Hobbit module to monitor
Flex License Manager. It seems to be working and delivering data in Hobbit under the column flexlm . 
On the server, the hobbitserver.cfg file has been changed like so: TEST2RRD="cpu=...  ... flexlm=ncv"
Data is delivered in the RRD file flexlm.rrd 
The data arrives OK into the rrd file, with the correct number of used licenses in last_ds field with the default data type DERIVE. 
SO far so good, but for the graphs, the datatype should be GAUGE. 
So I added the following line to hobbitserver.cfg : NCV_flexlm="MATLAB:GAUGE" 
I have tested this a few times, being extra careful to do: ~/server/bin/bb 127.0.0.1 "drop jotunn.rhi.hi.is flexlm" as hobbit user
then after stopping the server:

rm /var/lib/hobbit/rrd/jotunn.rhi.hi.is/flexlm.rrd

Start the server a minute later. 
Then the last_ds field is set to UNKN like in the following example. 
<!-- Round Robin Database Dump --><rrd> <version> 0003 </version>
        <step> 300 </step> <!-- Seconds -->
        <lastupdate> 1211985894 </lastupdate> <!-- 2008-05-28 14:44:54
GMT -->

        <ds>
                <name> MATLAB </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 600 </minimal_heartbeat>
                <min> 0.0000000000e+00 </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> UNKN </last_ds>
                <value> 5.8800000000e+02 </value>
                <unknown_sec> 0 </unknown_sec>
        </ds>

I wonder if this has something to do with the fact that the output format from my flexlm module to Hobbit is: $AWK '{printf "%.19s : %d\n", $3, $11 }' Resulting in lines like this: MATLAB : 1 
Maybe it is the \n in the format string or maybe there should be a space after the number. 
I am stuck here. Can anybody help me out. :) BTW: I am using Hobbit 4.2.0 with the allinone patch. 

On mið, 2008-05-28 at 15:22 +0000, Anna Jonna Armannsdottir wrote:

I wonder if this has something to do with the fact that the output format from my flexlm module to Hobbit is: $AWK '{printf "%.19s : %d\n", $3, $11 }' Resulting in lines like this: MATLAB : 1 

-- 
Kindest Regards, Anna Jonna Ármannsdóttir,       %&   A: Because people read from top to bottom.
Unix System Aministration, Computing Services,   %&   Q: Why is top posting bad?
University of Iceland.

On fim, 2008-05-29 at 13:32 -0400, michael nemeth wrote:

What does your graph def look like in hobbitgraph.cfg?

-- 
Kindest Regards, Anna Jonna Ármannsdóttir,       %&   A: Because people read from top to bottom.
Unix System Aministration, Computing Services,   %&   Q: Why is top posting bad?
University of Iceland.

On Fri, May 30, 2008 at 2:49 PM, Anna Jonna Armannsdottir <user-a8cde33204f6@xymon.invalid> wrote:

On fim, 2008-05-29 at 13:32 -0400, michael nemeth wrote:

What does your graph def look like in hobbitgraph.cfg?

It is ok, I found out. :-/

--
Kindest Regards, Anna Jonna Ármannsdóttir,       %&   A: Because people read from top to bottom.
Unix System Aministration, Computing Services,   %&   Q: Why is top posting bad?
University of Iceland.

-- 

On fös, 2008-05-30 at 16:03 -0400, Josh Luthman wrote:

Would you mind posting what you did wrong here should someone come
across the same situation and want to learn from your mistake?

        <ds>
                <name> MATLAB </name>
                <type> GAUGE </type>
                <minimal_heartbeat> 600 </minimal_heartbeat>
                <min> 0.0000000000e+00 </min>
                <max> NaN </max>

                <!-- PDP Status -->
                <last_ds> UNKN </last_ds>

-- 
Kindest Regards, Anna Jonna Ármannsdóttir,       %&   A: Because people read from top to bottom.
Unix System Aministration, Computing Services,   %&   Q: Why is top posting bad?
University of Iceland.

wrote:

On fös, 2008-05-30 at 16:03 -0400, Josh Luthman wrote:

Would you mind posting what you did wrong here should someone come
across the same situation and want to learn from your mistake?

Of course. :)
I expected the data in the rrd file to reflect directly
on the data that appears on the test page in Hobbit.
When the datatype is DERIVE, the number shown on the test
page in Hobbit - in this particular case flexlm and the
data shown is [ MATLAB : 2 ] - then this reflects directly
on <last_ds> field, the value is 2.

When the dataset is changed to GAUGE, the picture changes.
The value in the <last_ds> field, is always unknown.
The value field seems to be an integrated or averaged
function of the data shown in the test in Hobbit.