Creating a fake, or combination, client

8 messages in this thread

list Martin Ward · Tue, 6 Nov 2007 12:11:12 -0000 ·

Hi all,

I am a newbie to Hobbit and have inherited a working system. I have a
good idea of how it all hangs together but now I want to produce certain
graphs and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have
graphs showing the various mail queues (incoming, deferred etc) and this
data is stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that
can have a graph with data from all of these RRD files? Particularly I
would like a graph that has all the incoming mail queue sizes on it with
one line per server. I already have this information in lots of
different RRD files but would like to have them all in one graph. I can
create a graph outside of Hobbit to do this, but within the monitoring
system it restricts the RRD files it will display data from to those in
the data directory of the selected client (in the Trends link).

I have tried creating a new client in the data files ans symbolically
linking the other RRD files into its data directory, but cannot persude
the graphs to appear in the trends web page.

Thanks for your time,

|\/|artin
----
NetOps TAC
T:+44 20 7863 5218
Group: +49 69 56607 0412
F: +44 20 7863 5210

*************************************************************************************
The message is intended for the named addressee only and may not be disclosed to or used by anyone else, nor may it be copied in any way.

The contents of this message and its attachments are confidential and may also be subject to legal privilege. If you are not the named addressee and/or have received this message in error, please advise us by e-mailing user-61c7f445d564@xymon.invalid and delete the message and any attachments without retaining any copies.

Internet communications are not secure and COLT does not accept responsibility for this message, its contents nor responsibility for any viruses.

No contracts can be created or varied on behalf of COLT Telecommunications, its subsidiaries or affiliates ("COLT") and any other party by email Communications unless expressly agreed in writing with such other party.

Please note that incoming emails will be automatically scanned to eliminate potential viruses and unsolicited promotional emails. For more information refer to www.colt.net or contact us on +44(0)20 7390 3900.

list Gary Baluha · Tue, 6 Nov 2007 10:34:29 -0500 ·

▸ quoted from Martin Ward

On 11/6/07, Ward, Martin <user-2d33a6eb6a05@xymon.invalid> wrote:

 Hi all,

I am a newbie to Hobbit and have inherited a working system. I have a good
idea of how it all hangs together but now I want to produce certain graphs
and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have graphs
showing the various mail queues (incoming, deferred etc) and this data is
stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that can
have a graph with data from all of these RRD files? Particularly I would
like a graph that has all the incoming mail queue sizes on it with one line
per server. I already have this information in lots of different RRD files
but would like to have them all in one graph. I can create a graph outside
of Hobbit to do this, but within the monitoring system it restricts the RRD
files it will display data from to those in the data directory of the
selected client (in the Trends link).

Hmm.  You could probably create a host and set up a noconn test to some
random IP like 10.0.0.1 (i.e.  in bb-hosts:   10.0.0.1  fake-host  #
noconn).  Regardless of what host (or fake host, if you do that), you will
need to create a new RRD trend to that host.

You can create an RRD graph (by modifying hobbit-graph.cfg) that gets its
data from multiple RRD files.  These files are usually created in a
directory for each host, and I don't know if you can just create a symlink
to those or not.  But assuming that works, you should be all set in creating
a single graph that plots all the other data using a single scale.

I think you would want to add the following to hobbitserver.cfg:
GRAPHS="<whatever is already there>,custom-postfix"

And then hobbit-graph.cfg would look something like this:
[custom-postfix]
  . . .
  DEF:hosta:HostA.rrd:AVERAGE
  DEF:hostb:HostB.rrd:AVERAGE

▸ quoted from Martin Ward

  . . .

I have tried creating a new client in the data files ans symbolically

linking the other RRD files into its data directory, but cannot persude the
graphs to appear in the trends web page.

Thanks for your time,

|\/|artin

list Martin Ward · Tue, 6 Nov 2007 16:01:15 -0000 ·

Thanks Gary,
 
I think the thing I am missing in your example (and in general to be
honest) is: What is the link between fake-host in the bb-hosts file and
[custom-postfix] in the hobbitgraph.cfg file?
 
|\/|artin

▸ quoted from Gary Baluha

-----Original Message-----
From: Gary Baluha [mailto:user-ae3e15c22de1@xymon.invalid]
Sent: 06 November 2007 15:34
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Creating a fake, or combination, client

On 11/6/07, Ward, Martin <user-2d33a6eb6a05@xymon.invalid> wrote:

Hi all,

I am a newbie to Hobbit and have inherited a working
system. I have a good idea of how it all hangs together but now I want
to produce certain graphs and cannot figure out how.

I have a cluster of mail servers that run Postfix; each
of these clients is monitored within Hobbit. In the Trends link for each
client I have graphs showing the various mail queues (incoming, deferred
etc) and this data is stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or
meta- client that can have a graph with data from all of these RRD
files? Particularly I would like a graph that has all the incoming mail
queue sizes on it with one line per server. I already have this
information in lots of different RRD files but would like to have them
all in one graph. I can create a graph outside of Hobbit to do this, but
within the monitoring system it restricts the RRD files it will display
data from to those in the data directory of the selected client (in the
Trends link).

Hmm. You could probably create a host and set up a noconn test
to some random IP like 10.0.0.1 (i.e. in bb-hosts: 10.0.0.1
fake-host # noconn). Regardless of what host (or fake host, if you do
that), you will need to create a new RRD trend to that host.

You can create an RRD graph (by modifying hobbit-graph.cfg) that
gets its data from multiple RRD files. These files are usually created
in a directory for each host, and I don't know if you can just create a
symlink to those or not. But assuming that works, you should be all set
in creating a single graph that plots all the other data using a single
scale.

I think you would want to add the following to hobbitserver.cfg:
GRAPHS="<whatever is already there>,custom-postfix"

And then hobbit-graph.cfg would look something like this:
[custom-postfix]
. . .
DEF:hosta:HostA.rrd:AVERAGE
DEF:hostb:HostB.rrd:AVERAGE
. . .

I have tried creating a new client in the data files ans
symbolically linking the other RRD files into its data directory, but
cannot persude the graphs to appear in the trends web page.

Thanks for your time,

|\/|artin

Internet communications are not secure and COLT does not accept responsibility for this message, its contents nor responsibility for any viruses.

list Andy France · Wed, 7 Nov 2007 09:43:49 +1300 ·

Hi Martin,
 
I do a similar thing with our Citrix servers, where I have a "Farm" host
to hold a summary of the total number of connections across all servers.
 
I do this by running a script from hobbitlaunch on the server, and
summing up the results of the individual Citrix servers using
hobbitdboard.  After parsing the results, I send a single message for
the "Farm" host in the same format as the individual host messages and
Hobbit magically makes the graph for me :-)
 
It's not too flash, but here are all the bits and pieces which make it
work.  I hope they may help you in making a similar script for a postfix
farm.
 
 
BB-HOSTS ENTRIES :

	127.0.0.1       citrix-farm    # COMMENT:"Farm Totals" testip
noconn noinfo notrends
	192.168.1.101   citrix-01      # 
	192.168.1.102   citrix-02      # 

SHELL SCRIPT /opt/hobbit/bin/citrix-totals.sh :

	#!/bin/sh
	 
	TFIL=/tmp/`basename $0`.$$
	 
	/opt/hobbit/server/bin/bb localhost "hobbitdboard
host=citrix-[0-9][0-9] test=citrix fields=msg" | gsed 's/\\n/\n/g' >
${TFIL}
	 
	LINE=`grep -v 'users active' ${TFIL}`
	 
	CSUM=`grep "users active" ${TFIL} | awk ' { sum += $1; } END {
print sum; } '`
	 
	if [ -z "${CSUM}" ]
	then
	        CSUM=0
	fi
	 
	/opt/hobbit/server/bin/bb localhost "status citrix-farm.citrix
green `date`
	 
	${CSUM} users active
	 
	
	${LINE}"
	 
	rm ${TFIL}

HOBBITLAUNCH.CFG ENTRY:

	[citrix-totals]
	        ENVFILE /opt/hobbit/server/etc/hobbitserver.cfg
	        NEEDS hobbitd
	        CMD /opt/hobbit/bin/citrix-totals.sh
	        LOGFILE $BBSERVERLOGS/logs/citrix-totals.log
	        INTERVAL 5m

 
The paths for the binaries etc would obviously need massaging to suit
your installation.  Good luck!
 
Andy.

▸ quoted from Martin Ward

From: Ward, Martin [mailto:user-2d33a6eb6a05@xymon.invalid] 
Sent: Wednesday, 7 November 2007 1:11 a.m.
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] Creating a fake, or combination, client

Hi all, 

I am a newbie to Hobbit and have inherited a working system. I have a
good idea of how it all hangs together but now I want to produce certain
graphs and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have
graphs showing the various mail queues (incoming, deferred etc) and this
data is stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that
can have a graph with data from all of these RRD files? Particularly I
would like a graph that has all the incoming mail queue sizes on it with
one line per server. I already have this information in lots of
different RRD files but would like to have them all in one graph. I can
create a graph outside of Hobbit to do this, but within the monitoring
system it restricts the RRD files it will display data from to those in
the data directory of the selected client (in the Trends link).

I have tried creating a new client in the data files ans symbolically
linking the other RRD files into its data directory, but cannot persude
the graphs to appear in the trends web page.

Thanks for your time, 

|\/|artin 
---- 
NetOps TAC 
T:+44 20 7863 5218 
Group: +49 69 56607 0412 
F: +44 20 7863 5210 

#####################################################################################


This email is intended for the person to whom it is addressed
only. If you are not the intended recipient, do not read, copy
or use the contents in any way. The opinions expressed may not
necessarily reflect those of ZESPRI Group of Companies ('ZESPRI').

While every effort has been made to verify the information
contained herein, ZESPRI does not make any representations 
as to the accuracy of the information or to the performance
of any data, information or the products mentioned herein.
ZESPRI will not accept liability for any losses, damage or
consequence, however, resulting directly or indirectly from
the use of this e-mail/attachments.
#####################################################################################

list Gary Baluha · Tue, 6 Nov 2007 15:51:58 -0500 ·

▸ quoted from Andy France

On 11/6/07, Andy France <user-ee2a9e4eaf57@xymon.invalid> wrote:

 Hi Martin,

I do a similar thing with our Citrix servers, where I have a "Farm" host
to hold a summary of the total number of connections across all servers.

I do this by running a script from hobbitlaunch on the server, and summing
up the results of the individual Citrix servers using hobbitdboard.  After
parsing the results, I send a single message for the "Farm" host in the same
format as the individual host messages and Hobbit magically makes the graph
for me :-)

If you want to reuse the data in the existing RRD files, assuming a symlink
to them works as I previously described, you can probably just create a
script similar to below and have it output a dummy value.  The main purpose
of the script would then just be to associate a column with the dummy host,
that you can then build a graph for using existing RRD files.

▸ quoted from Andy France


It's not too flash, but here are all the bits and pieces which make it

work.  I hope they may help you in making a similar script for a postfix
farm.


*BB-HOSTS ENTRIES :*

127.0.0.1       citrix-farm    # COMMENT:"Farm Totals" testip noconn
noinfo notrends
192.168.1.101   citrix-01      #
192.168.1.102   citrix-02      #

*SHELL SCRIPT* /opt/hobbit/bin/citrix-totals.sh :

#!/bin/sh

TFIL=/tmp/`basename $0`.$$

/opt/hobbit/server/bin/bb localhost "hobbitdboard host=citrix-[0-9][0-9]
test=citrix fields=msg" | gsed 's/\\n/\n/g' > ${TFIL}

LINE=`grep -v 'users active' ${TFIL}`

CSUM=`grep "users active" ${TFIL} | awk ' { sum += $1; } END { print sum;
} '`

if [ -z "${CSUM}" ]
then
        CSUM=0
fi

/opt/hobbit/server/bin/bb localhost "status citrix-farm.citrix green
`date`

${CSUM} users active


${LINE}"

rm ${TFIL}

*HOBBITLAUNCH.CFG ENTRY:*

[citrix-totals]
        ENVFILE /opt/hobbit/server/etc/hobbitserver.cfg
        NEEDS hobbitd
        CMD /opt/hobbit/bin/citrix-totals.sh
        LOGFILE $BBSERVERLOGS/logs/citrix-totals.log
        INTERVAL 5m


The paths for the binaries etc would obviously need massaging to suit your
installation.  Good luck!

Andy.

*From:* Ward, Martin [mailto:user-2d33a6eb6a05@xymon.invalid]
*Sent:* Wednesday, 7 November 2007 1:11 a.m.
*To:* user-ae9b8668bcde@xymon.invalid
*Subject:* [hobbit] Creating a fake, or combination, client

 Hi all,

I am a newbie to Hobbit and have inherited a working system. I have a good
idea of how it all hangs together but now I want to produce certain graphs
and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have graphs
showing the various mail queues (incoming, deferred etc) and this data is
stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that can
have a graph with data from all of these RRD files? Particularly I would
like a graph that has all the incoming mail queue sizes on it with one line
per server. I already have this information in lots of different RRD files
but would like to have them all in one graph. I can create a graph outside
of Hobbit to do this, but within the monitoring system it restricts the RRD
files it will display data from to those in the data directory of the
selected client (in the Trends link).

I have tried creating a new client in the data files ans symbolically
linking the other RRD files into its data directory, but cannot persude the
graphs to appear in the trends web page.

Thanks for your time,

|\/|artin
----
NetOps TAC
T:+44 20 7863 5218
Group: +49 69 56607 0412
F: +44 20 7863 5210


#####################################################################################

This email is intended for the person to whom it is addressed
only. If you are not the intended recipient, do not read, copy
or use the contents in any way. The opinions expressed may not
necessarily reflect those of ZESPRI Group of Companies ('ZESPRI').

While every effort has been made to verify the information
contained herein, ZESPRI does not make any representations
as to the accuracy of the information or to the performance
of any data, information or the products mentioned herein.
ZESPRI will not accept liability for any losses, damage or
consequence, however, resulting directly or indirectly from
the use of this e-mail/attachments.

#####################################################################################

list Stef Coene · Tue, 6 Nov 2007 22:04:44 +0100 ·

▸ quoted from Gary Baluha

On Tuesday 06 November 2007, Ward, Martin wrote:

Hi all,

I am a newbie to Hobbit and have inherited a working system. I have a
good idea of how it all hangs together but now I want to produce certain
graphs and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have
graphs showing the various mail queues (incoming, deferred etc) and this
data is stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that
can have a graph with data from all of these RRD files? Particularly I
would like a graph that has all the incoming mail queue sizes on it with
one line per server. I already have this information in lots of
different RRD files but would like to have them all in one graph. I can
create a graph outside of Hobbit to do this, but within the monitoring
system it restricts the RRD files it will display data from to those in
the data directory of the selected client (in the Trends link).

I have tried creating a new client in the data files ans symbolically
linking the other RRD files into its data directory, but cannot persude
the graphs to appear in the trends web page.

You can create a custom cluster aware client that runs on the servers.  The client uses an other client node to report.

An other possibility is to create in the rrd directory a new directory and create symlinks in this directory so each server has a symbolic link in this directory for the rrd that has the needed info.  Give each symlink an other name.
I use this to collect information of the CPU usage of lpars running on the same hardware box.  So I created a new directory and created symlinks to the vmstat.rrd files I need.  So in that directory I have a symlink named server-vmstat.rrd that points to ../server/vmstat.rrd.   And that for each server running on that hardware box.  To create the graphs, I added a new stanza to hobbitgraphs.cfg that parses the  *-vmstat.rrd files.  To access these graphs, you have to play with the url.  The host parameter is the name of the created directory and the service is the name of added stamza.  You don't a link from a hobbit page to this graph, but I already had a "handy-url-page" where I added a link to this graph.


Stef

list Buchan Milne · Wed, 7 Nov 2007 12:08:26 +0200 ·

▸ quoted from Stef Coene

On Tuesday 06 November 2007 14:11:12 Ward, Martin wrote:

Hi all,

I am a newbie to Hobbit and have inherited a working system. I have a
good idea of how it all hangs together but now I want to produce certain
graphs and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have
graphs showing the various mail queues (incoming, deferred etc) and this
data is stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that
can have a graph with data from all of these RRD files? Particularly I
would like a graph that has all the incoming mail queue sizes on it with
one line per server. I already have this information in lots of
different RRD files but would like to have them all in one graph. I can
create a graph outside of Hobbit to do this, but within the monitoring
system it restricts the RRD files it will display data from to those in
the data directory of the selected client (in the Trends link).

No, not if you:
1)Have "multi" definitions for the graph you want
2)You specify multiple server names in the graph url, or use the 
Reports->Metrics Report feature. I prefer adding the server names in the 
graph url, as I can reload it to have it update (whereas using the Metrics 
Report requires you to go back and select a new date range).

You may want to try this with one of the existing tests that has "multi" 
support, mem, cpu have them by default.

Regards,
Buchan

list S Aiello · Wed, 7 Nov 2007 06:31:53 -0500 ·

▸ quoted from Buchan Milne

On Wednesday 07 November 2007, Buchan Milne wrote:

On Tuesday 06 November 2007 14:11:12 Ward, Martin wrote:

Hi all,

I am a newbie to Hobbit and have inherited a working system. I have a
good idea of how it all hangs together but now I want to produce certain
graphs and cannot figure out how.

I have a cluster of mail servers that run Postfix; each of these clients
is monitored within Hobbit. In the Trends link for each client I have
graphs showing the various mail queues (incoming, deferred etc) and this
data is stored in RRD files on the Hobbit server.

Is there a way within Hobbit of creating a false or meta- client that
can have a graph with data from all of these RRD files? Particularly I
would like a graph that has all the incoming mail queue sizes on it with
one line per server. I already have this information in lots of
different RRD files but would like to have them all in one graph. I can
create a graph outside of Hobbit to do this, but within the monitoring
system it restricts the RRD files it will display data from to those in
the data directory of the selected client (in the Trends link).

If you want to create a graph from multiple rrds, I would suggest using the 
3rd party tool called drraw (http://web.taranis.org/drraw/).

Creating a fake, or combination, client 🔗 link

Creating a fake, or combination, client