MySQL graphing woes

8 messages in this thread

list Charles Jones · Wed, 11 Apr 2007 21:55:00 -0700 ·

I'm setting up mysql checks and graphing using the hobbit-modified bb-mysql.pl. I have the statuses working fine:


      Thu Apr 12 04:42:40 2007 MySQL Server OK

threads: 10
questions: 2751997
slow queries: 2100
opens: 304
flush tables: 3
open tables: 100
queries per second avg: 8.514
maxcon: 400

Server version: 4.1.9-standard-log
Uptime: 3 days 17 hours 47 min 3 sec

Server reports timestamp of 2007-04-12 04:42:40


However, instead of a graph at the bottom, I just have:
"hobbit graph ncv:mysql" next to the hourglass. I'm using Hobbit 4.20 plus the latest "all in one" patch.

Here are the relevant sections from my config files, hopefully someone can point out what I'm doing wrong?
hobbitserver.cfg:
TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,files,procs=processes,ports,clock,lines,mysql=ncv"
GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql:mysqlslow,mysql:mysqlthread"
NCV_mysql="*:GAUGE"

hobbitgraph.cfg (these are the default entries that come with Hobbit):
[mysqlslow]
        DEF:slow=mysql.rrd:Slowqueries:AVERAGE
        TITLE MySQL Slow Queries
        YAXIS #
        LINE2:slow#00CCCC:Slow Queries
        COMMENT:\n
        GPRINT:slow:LAST: \: %5.1lf (cur)
        GPRINT:slow:MAX: \: %5.1lf (max)
        GPRINT:slow:MIN: \: %5.1lf (min)
        GPRINT:slow:AVERAGE: \: %5.1lf (avg)\n

[mysqlthread]
        DEF:threads=mysql.rrd:Threads:AVERAGE
        TITLE MySQL Active Threads
        YAXIS #
        AREA:threads#00CCCC:Threads
        COMMENT:\n
        GPRINT:threads:LAST: \: %5.1lf (cur)
        GPRINT:threads:MAX: \: %5.1lf (max)
        GPRINT:threads:MIN: \: %5.1lf (min)
        GPRINT:threads:AVERAGE: \: %5.1lf (avg)\n

Note I have also dumped out one of the rrd files, and they have data, so I don't think the problem lies with my NCV definition:
/$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/
                <name> threads </name>
                <value> 2.6730000000e+03 </value>
                <name> questions </name>
                <value> 8.1735172200e+08 </value>
                <name> slowqueries </name>
                <value> 6.2488800000e+05 </value>
                <name> opens </name>
                <value> 9.0288000000e+04 </value>
                <name> flushtables </name>
                <value> 8.9100000000e+02 </value>
                <name> opentables </name>
                <value> 2.9700000000e+04 </value>
                <name> queriespersecondavg </name>
                <value> 2.5239060000e+03 </value>
                <name> maxcon </name>
                <value> 1.1880000000e+05 </value>
                <name> Uptime </name>
                <value> 8.9100000000e+02 </value>
                <name> Serverreportstimest </name>
                <value> 1.5444000000e+04 </value>

So there we have it...the data is getting to Hobbit and being stored in the rrd files, it's just not displaying the graphs for some reason, and at the moment I can't see why. I searched the email archive and found lots of other posts of people having similar problems, with various solutions, none of which seem to work (yes I restart Hobbit after editing hobbitserver.cfg).

list Dominique Frise · Thu, 12 Apr 2007 07:30:55 +0200 ·

▸ quoted from Charles Jones

Charles Jones wrote:

I'm setting up mysql checks and graphing using the hobbit-modified 
bb-mysql.pl. I have the statuses working fine:


      Thu Apr 12 04:42:40 2007 MySQL Server OK

threads: 10
questions: 2751997
slow queries: 2100
opens: 304
flush tables: 3
open tables: 100
queries per second avg: 8.514
maxcon: 400

Server version: 4.1.9-standard-log
Uptime: 3 days 17 hours 47 min 3 sec

Server reports timestamp of 2007-04-12 04:42:40


However, instead of a graph at the bottom, I just have:
"hobbit graph ncv:mysql" next to the hourglass. I'm using Hobbit 4.20 
plus the latest "all in one" patch.

Here are the relevant sections from my config files, hopefully someone 
can point out what I'm doing wrong?
hobbitserver.cfg:
TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,files,procs=processes,ports,clock,lines,mysql=ncv"
GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql:mysqlslow,mysql:mysqlthread"
NCV_mysql="*:GAUGE"

hobbitgraph.cfg (these are the default entries that come with Hobbit):
[mysqlslow]
        DEF:slow=mysql.rrd:Slowqueries:AVERAGE
        TITLE MySQL Slow Queries
        YAXIS #
        LINE2:slow#00CCCC:Slow Queries
        COMMENT:\n
        GPRINT:slow:LAST: \: %5.1lf (cur)
        GPRINT:slow:MAX: \: %5.1lf (max)
        GPRINT:slow:MIN: \: %5.1lf (min)
        GPRINT:slow:AVERAGE: \: %5.1lf (avg)\n

[mysqlthread]
        DEF:threads=mysql.rrd:Threads:AVERAGE
        TITLE MySQL Active Threads
        YAXIS #
        AREA:threads#00CCCC:Threads
        COMMENT:\n
        GPRINT:threads:LAST: \: %5.1lf (cur)
        GPRINT:threads:MAX: \: %5.1lf (max)
        GPRINT:threads:MIN: \: %5.1lf (min)
        GPRINT:threads:AVERAGE: \: %5.1lf (avg)\n

Note I have also dumped out one of the rrd files, and they have data, so 
I don't think the problem lies with my NCV definition:
/$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/
                <name> threads </name>
                <value> 2.6730000000e+03 </value>
                <name> questions </name>
                <value> 8.1735172200e+08 </value>
                <name> slowqueries </name>
                <value> 6.2488800000e+05 </value>
                <name> opens </name>
                <value> 9.0288000000e+04 </value>
                <name> flushtables </name>
                <value> 8.9100000000e+02 </value>
                <name> opentables </name>
                <value> 2.9700000000e+04 </value>
                <name> queriespersecondavg </name>
                <value> 2.5239060000e+03 </value>
                <name> maxcon </name>
                <value> 1.1880000000e+05 </value>
                <name> Uptime </name>
                <value> 8.9100000000e+02 </value>
                <name> Serverreportstimest </name>
                <value> 1.5444000000e+04 </value>

So there we have it...the data is getting to Hobbit and being stored in 
the rrd files, it's just not displaying the graphs for some reason, and 
at the moment I can't see why. I searched the email archive and found 
lots of other posts of people having similar problems, with various 
solutions, none of which seem to work (yes I restart Hobbit after 
editing hobbitserver.cfg).

Your GRAPHS variable should be:

GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql"

In bb-hosts set the TRENDS directive for the host(s) like this:

TRENDS:*,mysql:mysqlslow|mysqlthreads


Dominique
UNIL - University of Lausanne

list Sabeer MZ · Thu, 12 Apr 2007 11:21:24 +0530 ·

There is good number of emails exchanged regarding mysql monitoring using
hobbit.
Please have a look on the last few months mail archive.

▸ quoted from Dominique Frise



On 4/12/07, Dominique Frise <user-78ab6673b600@xymon.invalid> wrote:

Charles Jones wrote:

I'm setting up mysql checks and graphing using the hobbit-modified
bb-mysql.pl. I have the statuses working fine:


      Thu Apr 12 04:42:40 2007 MySQL Server OK

threads: 10
questions: 2751997
slow queries: 2100
opens: 304
flush tables: 3
open tables: 100
queries per second avg: 8.514
maxcon: 400

Server version: 4.1.9-standard-log
Uptime: 3 days 17 hours 47 min 3 sec

Server reports timestamp of 2007-04-12 04:42:40


However, instead of a graph at the bottom, I just have:
"hobbit graph ncv:mysql" next to the hourglass. I'm using Hobbit 4.20
plus the latest "all in one" patch.

Here are the relevant sections from my config files, hopefully someone
can point out what I'm doing wrong?
hobbitserver.cfg:

TEST2RRD="cpu=la,disk,inode,qtree,memory,$PINGCOLUMN=tcp,http=tcp,dns=tcp,dig=tcp,time=ntpstat,vmstat,iostat,netstat,temperature,apache,bind,sendmail,mailq,nmailq=mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,files,procs=processes,ports,clock,lines,mysql=ncv"

GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,
tcp.http

,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql:mysqlslow,mysql:mysqlthread"

▸ quoted from Dominique Frise

NCV_mysql="*:GAUGE"

hobbitgraph.cfg (these are the default entries that come with Hobbit):
[mysqlslow]
        DEF:slow=mysql.rrd:Slowqueries:AVERAGE
        TITLE MySQL Slow Queries
        YAXIS #
        LINE2:slow#00CCCC:Slow Queries
        COMMENT:\n
        GPRINT:slow:LAST: \: %5.1lf (cur)
        GPRINT:slow:MAX: \: %5.1lf (max)
        GPRINT:slow:MIN: \: %5.1lf (min)
        GPRINT:slow:AVERAGE: \: %5.1lf (avg)\n

[mysqlthread]
        DEF:threads=mysql.rrd:Threads:AVERAGE
        TITLE MySQL Active Threads
        YAXIS #
        AREA:threads#00CCCC:Threads
        COMMENT:\n
        GPRINT:threads:LAST: \: %5.1lf (cur)
        GPRINT:threads:MAX: \: %5.1lf (max)
        GPRINT:threads:MIN: \: %5.1lf (min)
        GPRINT:threads:AVERAGE: \: %5.1lf (avg)\n

Note I have also dumped out one of the rrd files, and they have data, so
I don't think the problem lies with my NCV definition:
/$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/
                <name> threads </name>
                <value> 2.6730000000e+03 </value>
                <name> questions </name>
                <value> 8.1735172200e+08 </value>
                <name> slowqueries </name>
                <value> 6.2488800000e+05 </value>
                <name> opens </name>
                <value> 9.0288000000e+04 </value>
                <name> flushtables </name>
                <value> 8.9100000000e+02 </value>
                <name> opentables </name>
                <value> 2.9700000000e+04 </value>
                <name> queriespersecondavg </name>
                <value> 2.5239060000e+03 </value>
                <name> maxcon </name>
                <value> 1.1880000000e+05 </value>
                <name> Uptime </name>
                <value> 8.9100000000e+02 </value>
                <name> Serverreportstimest </name>
                <value> 1.5444000000e+04 </value>

So there we have it...the data is getting to Hobbit and being stored in
the rrd files, it's just not displaying the graphs for some reason, and
at the moment I can't see why. I searched the email archive and found
lots of other posts of people having similar problems, with various
solutions, none of which seem to work (yes I restart Hobbit after
editing hobbitserver.cfg).

Your GRAPHS variable should be:


GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,
tcp.http
,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql"

▸ quoted from Dominique Frise


In bb-hosts set the TRENDS directive for the host(s) like this:

TRENDS:*,mysql:mysqlslow|mysqlthreads


Dominique
UNIL - University of Lausanne

--


Thanks
Sabeer MZ

list Charles Jones · Fri, 13 Apr 2007 02:38:34 -0700 ·

Sabeer MZ wrote:

There is good number of emails exchanged regarding mysql monitoring 
using hobbit.
Please have a look on the last few months mail archive.

<snip>

    Charles Jones wrote:

at the moment I can't see why.* I searched the email archive*
    and found
lots of other posts of people having similar problems, with various
solutions, none of which seem to work (yes I restart Hobbit after
editing hobbitserver.cfg).

Thanks :-)
-Charles

list Charles Jones · Fri, 13 Apr 2007 02:44:36 -0700 ·

▸ quoted from Dominique Frise

Dominique Frise wrote:

Your GRAPHS variable should be:

GRAPHS="la,disk,inode,qtree,files,processes,memory,users,vmstat,iostat,tcp.http,tcp,ncv,netstat,ifstat,mrtg::1,ports,temperature,ntpstat,apache,bind,sendmail,mailq,socks,bea,iishealth,citrix,bbgen,bbtest,bbproxy,hobbitd,clock,lines,mysql" 


In bb-hosts set the TRENDS directive for the host(s) like this:

TRENDS:*,mysql:mysqlslow|mysqlthreads

I've tried that to no effect. Adding the TRENDS info to bb-hosts just 
gives me two lines of text after the graphs that say
hobbit graph mysqlslow   
hobbit graph mysqlthreads

-Charles

list Charles Goyard · Fri, 13 Apr 2007 12:14:31 +0200 ·

Hi,

your shoes don't match :)

The name in DEF:... should match the <name> section, case-sensitively.

▸ quoted from Charles Jones


Charles Jones wrote :

I'm setting up mysql checks and graphing using the hobbit-modified 
bb-mysql.pl. I have the statuses working fine:


[mysqlslow]
       DEF:slow=mysql.rrd:Slowqueries:AVERAGE

[mysqlthread]
       DEF:threads=mysql.rrd:Threads:AVERAGE

/$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/
               <name> threads </name>
               <name> slowqueries </name>


-- 
Charles Goyard - user-a6cdca7046e2@xymon.invalid - (+33) 1 45 38 01 31
Orange Business Services - online multimedia  // ingénierie

list Charles Jones · Fri, 13 Apr 2007 14:33:42 -0700 ·

Charles,

Heh, I had noticed that, but I thought to myself, "surely it isnt case sensitive" :)
I modified hobbitgraph.cfg and lowercased the DS names and that made the graphs appear in trends!

Now I just need to figure out why I'm not getting a graph at the bottom of the page of the "mysql" status page (I still have a broken graph link that says "hobbit graph ncv:mysql").

Thanks,
-Charles

▸ quoted from Charles Goyard


Charles Goyard wrote:

Hi,

your shoes don't match :)

The name in DEF:... should match the <name> section, case-sensitively.

Charles Jones wrote :

I'm setting up mysql checks and graphing using the hobbit-modified bb-mysql.pl. I have the statuses working fine:

[mysqlslow]
       DEF:slow=mysql.rrd:Slowqueries:AVERAGE

[mysqlthread]
       DEF:threads=mysql.rrd:Threads:AVERAGE

/$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/
               <name> threads </name>
               <name> slowqueries </name>

list Charles Jones · Fri, 20 Apr 2007 09:43:53 -0700 ·

Okay, I've almost got it all working the way I want :)
I fixed the missing graph displayed at the bottom of the "mysql" status column by adding a [mysql] graph to hobbitgraph.cfg. I just copied and pasted the entry for [mysqlthread].

So now I have working graphs at the bottom of the status page, as well as mysqlthread and mysqlslow graphs in the Trends column, but ONLY by modding my bb-hosts like so:

1.2.3.4   hostname.mydomain.com        # ssh TRENDS:*,mysql:mysqlslow|mysqlthread

Is there something I can put in the hobbitserver.cfg GRAPHS section so that these graphs are done by default, and thus not have to override TRENDS in bb-hosts ? I tried adding things like ",mysql:mysqlslow|mysqlthread" but that only seemed to add the one default mysql graph.

-Charles

▸ quoted from Charles Jones


Charles Jones wrote:

Charles,

Heh, I had noticed that, but I thought to myself, "surely it isnt case sensitive" :)
I modified hobbitgraph.cfg and lowercased the DS names and that made the graphs appear in trends!

Now I just need to figure out why I'm not getting a graph at the bottom of the page of the "mysql" status page (I still have a broken graph link that says "hobbit graph ncv:mysql").

Thanks,
-Charles

Charles Goyard wrote:

Hi,

your shoes don't match :)

The name in DEF:... should match the <name> section, case-sensitively.

Charles Jones wrote :

I'm setting up mysql checks and graphing using the hobbit-modified bb-mysql.pl. I have the statuses working fine:

[mysqlslow]
       DEF:slow=mysql.rrd:Slowqueries:AVERAGE

[mysqlthread]
       DEF:threads=mysql.rrd:Threads:AVERAGE

/$ rrdtool dump mysql.rrd |egrep 'name|value' | head -20/
               <name> threads </name>
               <name> slowqueries </name>

MySQL graphing woes 🔗 link

MySQL graphing woes