Xymon Mailing List Archive search

ifstat and hobbitclient-sunos.sh

33 messages in this thread

list Dominique Frise · Tue, 10 Oct 2006 15:18:28 +0200 · 
Hi,

The command "/usr/bin/kstat -p -s '[or]bytes64' | sort" for ifstat in hobbitclient-sunos.sh collects statistics for wrsmd (WCI Remote Shared Memory (WRSM) DLPI driver), which is wrong.

Example on a Solaris 9 client:

[bb at eliot bin]$ /usr/bin/kstat -p -s '[or]bytes64' | sort
eri:0:eri0:obytes64     363076089018
eri:0:eri0:rbytes64     15860668051
ge:0:ge0:obytes64       0
ge:0:ge0:rbytes64       0
wrsmd:0:wrsmd0:obytes64 0
wrsmd:0:wrsmd0:rbytes64 0
wrsmd:10:wrsmd10:obytes64       0
wrsmd:10:wrsmd10:rbytes64       0
wrsmd:11:wrsmd11:obytes64       0
wrsmd:11:wrsmd11:rbytes64       0
wrsmd:12:wrsmd12:obytes64       0
wrsmd:12:wrsmd12:rbytes64       0
wrsmd:13:wrsmd13:obytes64       0
wrsmd:13:wrsmd13:rbytes64       0
wrsmd:14:wrsmd14:obytes64       0
wrsmd:14:wrsmd14:rbytes64       0
wrsmd:15:wrsmd15:obytes64       0
wrsmd:15:wrsmd15:rbytes64       0
wrsmd:1:wrsmd1:obytes64 0
wrsmd:1:wrsmd1:rbytes64 0
wrsmd:2:wrsmd2:obytes64 0
wrsmd:2:wrsmd2:rbytes64 0
wrsmd:3:wrsmd3:obytes64 0
wrsmd:3:wrsmd3:rbytes64 0
wrsmd:4:wrsmd4:obytes64 0
wrsmd:4:wrsmd4:rbytes64 0
wrsmd:5:wrsmd5:obytes64 0
wrsmd:5:wrsmd5:rbytes64 0
wrsmd:6:wrsmd6:obytes64 0
wrsmd:6:wrsmd6:rbytes64 0
wrsmd:7:wrsmd7:obytes64 0
wrsmd:7:wrsmd7:rbytes64 0
wrsmd:8:wrsmd8:obytes64 0
wrsmd:8:wrsmd8:rbytes64 0
wrsmd:9:wrsmd9:obytes64 0
wrsmd:9:wrsmd9:rbytes64 0


A quick fix is to replace it with "/usr/bin/kstat -p -s '[or]bytes64' | grep -v wrsmd | sort"


Dominique
UNIL - University of Lausanne
list Thomas Seglard · Tue, 10 Oct 2006 17:09:16 +0200 · 
Hi,

I'm just asking you how do you monitor your MySQL databases ? I've setted up the bb-mysqlstatus.sh and modify it to support NCV format. Now I got graphs for queries/sec and slowqueries. That's cool but it's not very accurate... I'm using MySQL Administrator from http://dev.mysql.com/downloads/gui-tools/5.0.html and results are not the same. Did you write something to track insert, select, etc. from 'mysqladmin extended-status' ? Thanks for your help !
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Matthew Davis · Tue, 10 Oct 2006 12:43:29 -0400 ·
▸ quoted from Thomas Seglard
On 10/10/06, user-bb3e9041f07f@xymon.invalid <user-bb3e9041f07f@xymon.invalid> wrote:
I'm just asking you how do you monitor your MySQL databases ? I've setted
Attached is a script I wrote up one night based off MySQL Activity
Report (http://gert.sos.be/en/projects/mysqlar/).  Can't guarantee
it'll work, but it works for me with 4.1.21.

It does the following:

- max connections vs threads connected
- (Questions / Selects / Inserts / Updates / Deletes) per minute
- Table Cache vs Open Tables
- Created Tmp Tables vs Tmp Disk Tables  <-- logic is wrong here I
know I need to fix this

It was my 2nd hobbit script, so please let me know where I can improve.

-- 
Matthew Davis
http://familycampground.org/matthew/
list Eric Meddaugh · Tue, 10 Oct 2006 14:44:55 -0400 · 
I saw this too with some of our clients, so this is what I did for that:

   echo "[ifstat]"
   LINE=`/sbin/ifconfig -a | /bin/egrep RUNNING | /bin/awk -F':'
'{printf $1"\n"}' | /bin/sort -u | /bin/awk '{printf $1"|"}'`
   /usr/bin/kstat -p -s '[or]bytes64' | sort | egrep "${LINE}"

This way it only grabs the interfaces that are running.

---Eric
▸ quoted from Dominique Frise

-----Original Message-----
From: Dominique Frise [mailto:user-78ab6673b600@xymon.invalid] 
Sent: Tuesday, October 10, 2006 09:18
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] ifstat and hobbitclient-sunos.sh

Hi,

The command "/usr/bin/kstat -p -s '[or]bytes64' | sort" for ifstat in 
hobbitclient-sunos.sh collects statistics for wrsmd (WCI Remote Shared
Memory 
(WRSM) DLPI driver), which is wrong.

Example on a Solaris 9 client:

[bb at eliot bin]$ /usr/bin/kstat -p -s '[or]bytes64' | sort
eri:0:eri0:obytes64     363076089018
eri:0:eri0:rbytes64     15860668051
ge:0:ge0:obytes64       0
ge:0:ge0:rbytes64       0
wrsmd:0:wrsmd0:obytes64 0
wrsmd:0:wrsmd0:rbytes64 0
wrsmd:10:wrsmd10:obytes64       0
wrsmd:10:wrsmd10:rbytes64       0
wrsmd:11:wrsmd11:obytes64       0
wrsmd:11:wrsmd11:rbytes64       0
wrsmd:12:wrsmd12:obytes64       0
wrsmd:12:wrsmd12:rbytes64       0
wrsmd:13:wrsmd13:obytes64       0
wrsmd:13:wrsmd13:rbytes64       0
wrsmd:14:wrsmd14:obytes64       0
wrsmd:14:wrsmd14:rbytes64       0
wrsmd:15:wrsmd15:obytes64       0
wrsmd:15:wrsmd15:rbytes64       0
wrsmd:1:wrsmd1:obytes64 0
wrsmd:1:wrsmd1:rbytes64 0
wrsmd:2:wrsmd2:obytes64 0
wrsmd:2:wrsmd2:rbytes64 0
wrsmd:3:wrsmd3:obytes64 0
wrsmd:3:wrsmd3:rbytes64 0
wrsmd:4:wrsmd4:obytes64 0
wrsmd:4:wrsmd4:rbytes64 0
wrsmd:5:wrsmd5:obytes64 0
wrsmd:5:wrsmd5:rbytes64 0
wrsmd:6:wrsmd6:obytes64 0
wrsmd:6:wrsmd6:rbytes64 0
wrsmd:7:wrsmd7:obytes64 0
wrsmd:7:wrsmd7:rbytes64 0
wrsmd:8:wrsmd8:obytes64 0
wrsmd:8:wrsmd8:rbytes64 0
wrsmd:9:wrsmd9:obytes64 0
wrsmd:9:wrsmd9:rbytes64 0


A quick fix is to replace it with "/usr/bin/kstat -p -s '[or]bytes64' |
grep -v 
wrsmd | sort"


Dominique
UNIL - University of Lausanne
list Francesco Duranti · Tue, 10 Oct 2006 21:16:24 +0200 · 
You can use also dbcheck.pl to track the mysql database (connection and
same stats as the normal sqlstatus script).
The new version also has a custom query engine so it's possible to write
to query to analyze and if someone know how to get more data out of
sqlserver with query or sql command I can arrange some more checks for
it (and graphs also...).

Francesco
▸ quoted from Thomas Seglard
 
-----Original Message-----
From: user-bb3e9041f07f@xymon.invalid [mailto:user-bb3e9041f07f@xymon.invalid] Sent: Tuesday, October 10, 2006 5:09 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] - MySQL monitoring

Hi,

I'm just asking you how do you monitor your MySQL databases ? I've setted up the bb-mysqlstatus.sh and modify it to support NCV format. Now I got graphs for queries/sec and slowqueries. That's cool but it's not very accurate... I'm using MySQL Administrator from http://dev.mysql.com/downloads/gui-tools/5.0.html and results are not the same. Did you write something to track insert, select, etc. from 'mysqladmin extended-status' ? Thanks for your help !
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Seglard · Wed, 11 Oct 2006 12:23:21 +0200 · 
Thanks for your script and the link, they are very useful... All are 
working perfectly. I will check the mysqlar site soon.
Best regards,

Thomas

user-c1a011f706f7@xymon.invalid a écrit sur 10/10/2006 18:43:29 :
▸ quoted from Matthew Davis
On 10/10/06, user-bb3e9041f07f@xymon.invalid <user-bb3e9041f07f@xymon.invalid> 
wrote:
I'm just asking you how do you monitor your MySQL databases ? I've 
setted
Attached is a script I wrote up one night based off MySQL Activity
Report (http://gert.sos.be/en/projects/mysqlar/).  Can't guarantee
it'll work, but it works for me with 4.1.21.

It does the following:

- max connections vs threads connected
- (Questions / Selects / Inserts / Updates / Deletes) per minute
- Table Cache vs Open Tables
- Created Tmp Tables vs Tmp Disk Tables  <-- logic is wrong here I
know I need to fix this

It was my 2nd hobbit script, so please let me know where I can improve.

-- 
Matthew Davis
http://familycampground.org/matthew/

[rattachement "mysql-activity.tar.gz" supprimé par Thomas 
SEGLARD/FI6/ANFI/CNP Assurances] To unsubscribe from the hobbit 
list, send an e-mail to
user-095ef1c764a2@xymon.invalid
▸ quoted from Francesco Duranti

Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Seglard · Wed, 11 Oct 2006 12:25:03 +0200 · 
Hi Francesco,

I'm sorry, I missed the new version and the query engine. I will try to look at it soon.
Best regards,

Thomas

"Francesco Duranti" <user-7104dcecbfef@xymon.invalid> a écrit sur 10/10/2006 21:16:24 :
▸ quoted from Thomas Seglard
You can use also dbcheck.pl to track the mysql database (connection and
same stats as the normal sqlstatus script).
The new version also has a custom query engine so it's possible to write
to query to analyze and if someone know how to get more data out of
sqlserver with query or sql command I can arrange some more checks for
it (and graphs also...).

Francesco


-----Original Message-----
From: user-bb3e9041f07f@xymon.invalid > [mailto:user-bb3e9041f07f@xymon.invalid] > Sent: Tuesday, October 10, 2006 5:09 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] - MySQL monitoring
Hi,
I'm just asking you how do you monitor your MySQL databases ? > I've setted up the bb-mysqlstatus.sh and modify it to support > NCV format. Now I got graphs for queries/sec and slowqueries. > That's cool but it's not very accurate... I'm using MySQL > Administrator from > http://dev.mysql.com/downloads/gui-tools/5.0.html and results > are not the same. Did you write something to track insert, > select, etc. from 'mysqladmin extended-status' ? Thanks for > your help !
Sincerly,
Thomas
Ce message (et toutes ses pieces jointes eventuelles) est > confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa > destination, toute diffusion ou toute publication, totale ou > partielle, est interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce > message, CNP Assurances et ses filiales declinent toute > responsabilite au titre de ce message, s'il a ete altere, > deforme ou falsifie.
*****
This message and any attachments (the "message") are > confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or > affiliates shall be liable for the message if altered, > changed or falsified.
Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Great Dilla · Tue, 17 Oct 2006 15:38:51 -0400 · 
How about using mysqlreport? (http://hackmysql.com/mysqlreport)

It could run as cgi-bin script probably in the hobbit server itself or
the client. It requires perl and the appropriate DBI modules.

I'm looking into incorporating replication slave monitoring into the script.
▸ quoted from Thomas Seglard

On 10/11/06, user-bb3e9041f07f@xymon.invalid <user-bb3e9041f07f@xymon.invalid> wrote:
Hi Francesco,

I'm sorry, I missed the new version and the query engine. I will try to
look at it soon.
Best regards,

Thomas

"Francesco Duranti" <user-7104dcecbfef@xymon.invalid> a écrit sur 10/10/2006 21:16:24 :

You can use also dbcheck.pl to track the mysql database (connection and
same stats as the normal sqlstatus script).
The new version also has a custom query engine so it's possible to write
to query to analyze and if someone know how to get more data out of
sqlserver with query or sql command I can arrange some more checks for
it (and graphs also...).

Francesco


-----Original Message-----
From: user-bb3e9041f07f@xymon.invalid
[mailto:user-bb3e9041f07f@xymon.invalid]
Sent: Tuesday, October 10, 2006 5:09 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] - MySQL monitoring

Hi,

I'm just asking you how do you monitor your MySQL databases ?
I've setted up the bb-mysqlstatus.sh and modify it to support
NCV format. Now I got graphs for queries/sec and slowqueries.
That's cool but it's not very accurate... I'm using MySQL
Administrator from
http://dev.mysql.com/downloads/gui-tools/5.0.html and results
are not the same. Did you write something to track insert,
select, etc. from 'mysqladmin extended-status' ? Thanks for
your help !
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est
confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa
destination, toute diffusion ou toute publication, totale ou
partielle, est interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce
message, CNP Assurances et ses filiales declinent toute
responsabilite au titre de ce message, s'il a ete altere,
deforme ou falsifie.

*****

This message and any attachments (the "message") are
confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or
affiliates shall be liable for the message if altered,
changed or falsified.


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Francesco Duranti · Tue, 17 Oct 2006 22:05:19 +0200 · 
I'll check the script to understand what can be get and monitored from a mysql server for a next version of dbcheck. Thanks for the links :D

Francesco
▸ quoted from Great Dilla
 
-----Original Message-----
From: Great Dilla [mailto:user-3e85c7b9d5a4@xymon.invalid] Sent: Tuesday, October 17, 2006 9:39 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] - MySQL monitoring

How about using mysqlreport? (http://hackmysql.com/mysqlreport)

It could run as cgi-bin script probably in the hobbit server itself or the client. It requires perl and the appropriate DBI modules.

I'm looking into incorporating replication slave monitoring into the script.

On 10/11/06, user-bb3e9041f07f@xymon.invalid <user-bb3e9041f07f@xymon.invalid> wrote:
Hi Francesco,

I'm sorry, I missed the new version and the query engine. I will try > to look at it soon.
Best regards,

Thomas

"Francesco Duranti" <user-7104dcecbfef@xymon.invalid> a écrit sur 10/10/2006 21:16:24 :

You can use also dbcheck.pl to track the mysql database (connection > > and same stats as the normal sqlstatus script).
The new version also has a custom query engine so it's possible to > > write to query to analyze and if someone know how to get more data > > out of sqlserver with query or sql command I can arrange some more > > checks for it (and graphs also...).

Francesco


-----Original Message-----
From: user-bb3e9041f07f@xymon.invalid
[mailto:user-bb3e9041f07f@xymon.invalid]
Sent: Tuesday, October 10, 2006 5:09 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: [hobbit] - MySQL monitoring

Hi,

I'm just asking you how do you monitor your MySQL databases ?
I've setted up the bb-mysqlstatus.sh and modify it to support NCV > > > format. Now I got graphs for queries/sec and slowqueries.
That's cool but it's not very accurate... I'm using MySQL > > > Administrator from > > > http://dev.mysql.com/downloads/gui-tools/5.0.html and results are > > > not the same. Did you write something to track insert, select, > > > etc. from 'mysqladmin extended-status' ? Thanks for your help !
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est > > > confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, > > > toute diffusion ou toute publication, totale ou partielle, est > > > interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, > > > CNP Assurances et ses filiales declinent toute responsabilite au > > > titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential > > > and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates > > > shall be liable for the message if altered, changed or falsified.


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute > diffusion ou toute publication, totale ou partielle, est interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP > Assurances et ses filiales declinent toute responsabilite au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Seglard · Mon, 30 Oct 2006 15:09:20 +0100 · 
Hi,

I got a space problem on my hobbit server (4.2.0-1). Actually, my data directory is approaching 40G of occupied space. I have no more space on my disk so I'm worrying myself a bit ! I've already done a './trimhistory --drop[svcs|logs]' but I earned just a few Mb... What can I remove from the data directory ?

Here is some figures and a picture :

8,6G    ./data/histlogs
26G     ./data/hostdata
35G     ./data
▸ quoted from Francesco Duranti


Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Rich Smrcina · Mon, 30 Oct 2006 08:10:18 -0600 · 
How long do you need to keep data?  You can specify a date on trimhistory (see the man pages) and any log data before that date will be deleted.
▸ quoted from Thomas Seglard

user-bb3e9041f07f@xymon.invalid wrote:
Hi,

I got a space problem on my hobbit server (4.2.0-1). Actually, my data directory is approaching 40G of occupied space. I have no more space on my disk so I'm worrying myself a bit ! I've already done a './trimhistory --drop[svcs|logs]' but I earned just a few Mb... What can I remove from the data directory ?

Here is some figures and a picture :

8,6G    ./data/histlogs
26G     ./data/hostdata
35G     ./data


Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.


-- 

Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007
list Thomas Seglard · Mon, 30 Oct 2006 15:39:05 +0100 · 
Hi,

on my 'all non-green view', hobbit says : "No events received in last 240 
minutes"... Though, it's not possible ! When I'm checking history button 
on some systems I can see events happened. So what's wrong ? I'm running 
Hobbit 4.2.0 with all-in-one patch on a Linux box.
Best regards,
▸ quoted from Rich Smrcina

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Rich Smrcina · Mon, 30 Oct 2006 08:39:45 -0600 · 
There is a known problem when running trimhistory, the non-green page does not get updated properly.  You will need to bounce Hobbit and it will start logging again.
▸ quoted from Thomas Seglard

user-bb3e9041f07f@xymon.invalid wrote:
Hi,

on my 'all non-green view', hobbit says : "No events received in last 240 minutes"... Though, it's not possible ! When I'm checking history button on some systems I can see events happened. So what's wrong ? I'm running Hobbit 4.2.0 with all-in-one patch on a Linux box.
Best regards,

Thomas

-- 
Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007
list Thomas Seglard · Mon, 30 Oct 2006 15:45:20 +0100 · 
I specified a date with trimhistory (1st june 2006) but it doesn't seem to remove files in some hostdata directories. I executed again trimhistory to remove all files/logs before the 1st of september this year. In spite of that, I can see some files before this date were not removed from the hostdata directory :

[hobbit at psi200 psp145b]$ ls -ltr |more
total 2280296
-rw-rw-r--  1 hobbit hobbit 123509 aoû 10 16:16 1155219302
-rw-rw-r--  1 hobbit hobbit 122816 aoû 10 16:18 1155219426
-rw-rw-r--  1 hobbit hobbit 121728 aoû 10 16:21 1155219550
-rw-rw-r--  1 hobbit hobbit 122275 aoû 10 16:23 1155219673
-rw-rw-r--  1 hobbit hobbit 122391 aoû 10 16:25 1155219791
[snip]
-rw-rw-r--  1 hobbit hobbit 277910 aoû 31 23:51 1157060958
-rw-rw-r--  1 hobbit hobbit 277830 aoû 31 23:55 1157061259
-rw-rw-r--  1 hobbit hobbit 280192 sep  1 00:05 1157061858
-rw-rw-r--  1 hobbit hobbit 272742 sep  1 00:09 1157062159
-rw-rw-r--  1 hobbit hobbit 270990 sep  1 00:15 1157062458
-rw-rw-r--  1 hobbit hobbit 274434 sep  1 00:22 1157062759

Thanks for your help !
Sincerly,

Thomas

Rich Smrcina <user-cf452ff334e0@xymon.invalid> a écrit sur 30/10/2006 15:10:18 :
▸ quoted from Thomas Seglard
How long do you need to keep data?  You can specify a date on trimhistory (see the man pages) and any log data before that date will be deleted.

user-bb3e9041f07f@xymon.invalid wrote:
Hi,
I got a space problem on my hobbit server (4.2.0-1). Actually, my data > directory is approaching 40G of occupied space. I have no more space 
on my 
disk so I'm worrying myself a bit ! I've already done a './trimhistory > --drop[svcs|logs]' but I earned just a few Mb... What can I remove 
from 
the data directory ?
Here is some figures and a picture :
8,6G    ./data/histlogs
26G     ./data/hostdata
35G     ./data
Thomas
Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.
*****
This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
-- 
Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Rich Smrcina · Mon, 30 Oct 2006 08:52:06 -0600 · 
Can you send the command that you used?
▸ quoted from Thomas Seglard

user-bb3e9041f07f@xymon.invalid wrote:
I specified a date with trimhistory (1st june 2006) but it doesn't seem to remove files in some hostdata directories. I executed again trimhistory to remove all files/logs before the 1st of september this year. In spite of that, I can see some files before this date were not removed from the 
hostdata directory :

[hobbit at psi200 psp145b]$ ls -ltr |more
total 2280296
-rw-rw-r--  1 hobbit hobbit 123509 aoû 10 16:16 1155219302
-rw-rw-r--  1 hobbit hobbit 122816 aoû 10 16:18 1155219426
-rw-rw-r--  1 hobbit hobbit 121728 aoû 10 16:21 1155219550
-rw-rw-r--  1 hobbit hobbit 122275 aoû 10 16:23 1155219673
-rw-rw-r--  1 hobbit hobbit 122391 aoû 10 16:25 1155219791
[snip]
-rw-rw-r--  1 hobbit hobbit 277910 aoû 31 23:51 1157060958
-rw-rw-r--  1 hobbit hobbit 277830 aoû 31 23:55 1157061259
-rw-rw-r--  1 hobbit hobbit 280192 sep  1 00:05 1157061858
-rw-rw-r--  1 hobbit hobbit 272742 sep  1 00:09 1157062159
-rw-rw-r--  1 hobbit hobbit 270990 sep  1 00:15 1157062458
-rw-rw-r--  1 hobbit hobbit 274434 sep  1 00:22 1157062759

Thanks for your help !
Sincerly,

Thomas

-- 
Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007
list Thomas Seglard · Mon, 30 Oct 2006 15:53:26 +0100 · 
I restarted hobbit and then I can see my events again ! Thanks for this information.
Regards,

Thomas

Rich Smrcina <user-cf452ff334e0@xymon.invalid> a écrit sur 30/10/2006 15:39:45 :
▸ quoted from Thomas Seglard
There is a known problem when running trimhistory, the non-green page does not get updated properly.  You will need to bounce Hobbit and it will start logging again.

user-bb3e9041f07f@xymon.invalid wrote:
Hi,
on my 'all non-green view', hobbit says : "No events received in last 240 > minutes"... Though, it's not possible ! When I'm checking history 
button 
on some systems I can see events happened. So what's wrong ? I'm 
running 
Hobbit 4.2.0 with all-in-one patch on a Linux box.
Best regards,
Thomas

-- 
Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Henrik Størner · Mon, 30 Oct 2006 16:06:13 +0100 ·
▸ quoted from Thomas Seglard
On Mon, Oct 30, 2006 at 03:09:20PM +0100, user-bb3e9041f07f@xymon.invalid wrote:
Hi,

I got a space problem on my hobbit server (4.2.0-1). Actually, my data directory is approaching 40G of occupied space. I have no more space on my disk so I'm worrying myself a bit ! I've already done a './trimhistory --drop[svcs|logs]' but I earned just a few Mb... What can I remove from the data directory ?

Here is some figures and a picture :

8,6G    ./data/histlogs
26G     ./data/hostdata
trimhistory fails to remove data from the hostdata directory. Do a
   find ./data/hostdata -mtime +90 | xargs rm -f

to delete hostdata files older than 90 days.


Regards,
Henrik
list Thomas Seglard · Mon, 30 Oct 2006 16:10:31 +0100 · 
Sure ! Here they are :

./trimhistory --cutoff=`date +%s --date="1 sep 2006"` --dropsvcs
./trimhistory --cutoff=`date +%s --date="1 sep 2006"` --droplogs
./trimhistory --cutoff=`date +%s --date="1 sep 2006"` --drop

Sincerly,

Thomas

Rich Smrcina <user-cf452ff334e0@xymon.invalid> a écrit sur 30/10/2006 15:52:06 :
▸ quoted from Rich Smrcina
Can you send the command that you used?

user-bb3e9041f07f@xymon.invalid wrote:
I specified a date with trimhistory (1st june 2006) but it doesn't
seem to remove files in some hostdata directories. I executed again 
trimhistory to remove all files/logs before the 1st of september 
this year. In spite of that, I can see some files before this date 
were not removed from the 
hostdata directory :

[hobbit at psi200 psp145b]$ ls -ltr |more
total 2280296
-rw-rw-r--  1 hobbit hobbit 123509 aoû 10 16:16 1155219302
-rw-rw-r--  1 hobbit hobbit 122816 aoû 10 16:18 1155219426
-rw-rw-r--  1 hobbit hobbit 121728 aoû 10 16:21 1155219550
-rw-rw-r--  1 hobbit hobbit 122275 aoû 10 16:23 1155219673
-rw-rw-r--  1 hobbit hobbit 122391 aoû 10 16:25 1155219791
[snip]
-rw-rw-r--  1 hobbit hobbit 277910 aoû 31 23:51 1157060958
-rw-rw-r--  1 hobbit hobbit 277830 aoû 31 23:55 1157061259
-rw-rw-r--  1 hobbit hobbit 280192 sep  1 00:05 1157061858
-rw-rw-r--  1 hobbit hobbit 272742 sep  1 00:09 1157062159
-rw-rw-r--  1 hobbit hobbit 270990 sep  1 00:15 1157062458
-rw-rw-r--  1 hobbit hobbit 274434 sep  1 00:22 1157062759

Thanks for your help !
Sincerly,

Thomas

-- 
Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Rich Smrcina · Mon, 30 Oct 2006 09:12:38 -0600 · 
Henrik,

Is this intentional or a minor oversight?
▸ quoted from Henrik Størner

Henrik Stoerner wrote:
On Mon, Oct 30, 2006 at 03:09:20PM +0100, user-bb3e9041f07f@xymon.invalid wrote:
Hi,

I got a space problem on my hobbit server (4.2.0-1). Actually, my data directory is approaching 40G of occupied space. I have no more space on my disk so I'm worrying myself a bit ! I've already done a './trimhistory --drop[svcs|logs]' but I earned just a few Mb... What can I remove from the data directory ?

Here is some figures and a picture :

8,6G    ./data/histlogs
26G     ./data/hostdata
trimhistory fails to remove data from the hostdata directory. Do a
   find ./data/hostdata -mtime +90 | xargs rm -f

to delete hostdata files older than 90 days.


Regards,
Henrik


-- 
Rich Smrcina
VM Assist, Inc.
Phone: XXX-XXX-XXXX
Ans Service:  XXX-XXX-XXXX
user-61add9955ef9@xymon.invalid

Catch the WAVV!  http://www.wavv.org
WAVV 2007 - Green Bay, WI - May 18-22, 2007
list Thomas Seglard · Mon, 30 Oct 2006 16:23:36 +0100 · 
Thanks for this info. I used this command and now my disk space is correct.
Regards,

Thomas

user-ce4a2c883f75@xymon.invalid (Henrik Stoerner) a écrit sur 30/10/2006 16:06:13 :
▸ quoted from Thomas Seglard
On Mon, Oct 30, 2006 at 03:09:20PM +0100, user-bb3e9041f07f@xymon.invalid 
wrote:
Hi,
I got a space problem on my hobbit server (4.2.0-1). Actually, my data > directory is approaching 40G of occupied space. I have no more space 
on my 
disk so I'm worrying myself a bit ! I've already done a './trimhistory > --drop[svcs|logs]' but I earned just a few Mb... What can I remove 
from 
the data directory ?
Here is some figures and a picture :
8,6G    ./data/histlogs
26G     ./data/hostdata
trimhistory fails to remove data from the hostdata directory. Do a
   find ./data/hostdata -mtime +90 | xargs rm -f

to delete hostdata files older than 90 days.


Regards,
Henrik


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Henrik Størner · Mon, 30 Oct 2006 16:33:56 +0100 ·
▸ quoted from Rich Smrcina
On Mon, Oct 30, 2006 at 09:12:38AM -0600, Rich Smrcina wrote:
trimhistory fails to remove data from the hostdata directory. Do a
Is this intentional or a minor oversight?
It isn't intentional, so ....


Regards,
Henrik
list Thomas Seglard · Fri, 3 Nov 2006 19:14:08 +0100 · 
Hi,

I'm playing with linecount facility and it's really amazing. I will use it to trace connection numbers from applications and error messages from log files. I'm reading documentation on it for several hours (it's friday afternoon so I'm a bit slow :D) and don't figure how to 'grep' words from a set of files and graph the total number of matches. Here is an example of what I want to do. 
My log files are within this directory /projets/mut/home/mutrec2/wls_
traitement/mut-domain2/logs/ . Then I would like to run this command and be able to graph result : 
$ grep -i -E '(SEVERE|Error)' *log*|wc -l
        98

Is there a way to do such thing ?
▸ quoted from Thomas Seglard
Best regards,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Seglard · Mon, 13 Nov 2006 13:51:04 +0100 · 
Hello,

I got display problem with legends on disk graphs. Name of filesystems are on the left (that's ok) but figures/percentile are on far right. In some cases, I can't see the average value. Is it a problem with rrdtool (my version is 1.2.15) or is an option in Hobbit to be modify ? My configuration is Hobbit 4.2.0 patched with all-in-one patch.
▸ quoted from Thomas Seglard
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Seglard · Mon, 13 Nov 2006 13:56:47 +0100 · 
Hi,

I'm sorry to ask you this question again but does someone got Hobbit 4.2 
running on AIX 4.2 ? I can't neither compile client with gcc nor IBM cc. 
Henrik made a patch to fix that but it doesn't work.
▸ quoted from Thomas Seglard
Best regards,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Seglard · Fri, 8 Dec 2006 11:26:27 +0100 · 
Hello,

I'm asking here if I can use Hobbit as a "probe" to test Internet sites. I want to be able to trace requests and provide to customers response time of these requests. Basically, the 'cont' test of Hobbit is not sufficient 'cause you only test static pages. My main objective is to write some scenarios like : login with this login/pass / go to these links (trying to do some requests on Weblogic and database) / logout
Does anybody have already set up scripts like that ? Thanks for help !
▸ quoted from Thomas Seglard
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Thomas Pedersen · Fri, 08 Dec 2006 13:23:34 +0100 · 
Yes hobbit can do this via POST form login. Check the HTTP cont tag.
▸ quoted from Thomas Seglard

user-bb3e9041f07f@xymon.invalid wrote:
Hello,

I'm asking here if I can use Hobbit as a "probe" to test Internet sites. I want to be able to trace requests and provide to customers response time of these requests. Basically, the 'cont' test of Hobbit is not sufficient 'cause you only test static pages. My main objective is to write some scenarios like : login with this login/pass / go to these links (trying to do some requests on Weblogic and database) / logout
Does anybody have already set up scripts like that ? Thanks for help !
Sincerly,

Thomas


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Ralph Mitchell · Fri, 8 Dec 2006 06:35:28 -0600 ·
▸ quoted from Thomas Pedersen
On 12/8/06, Thomas <user-97316fb2dd2a@xymon.invalid> wrote:
Yes hobbit can do this via POST form login. Check the HTTP cont tag.

user-bb3e9041f07f@xymon.invalid wrote:
Hello,

I'm asking here if I can use Hobbit as a "probe" to test Internet sites. I
want to be able to trace requests and provide to customers response time
of these requests. Basically, the 'cont' test of Hobbit is not sufficient
'cause you only test static pages. My main objective is to write some
scenarios like : login with this login/pass / go to these links (trying to
do some requests on Weblogic and database) / logout
Does anybody have already set up scripts like that ? Thanks for help !
You'll probably need to use external scripts if the pages are
complicated.  The sequence I use is something like:

   download the page using curl
   grep for something in the html to show it is a good page
   extract the login form elements and edit in the userid & password
   POST the form back using curl, and save the returned page
   grep for something in the returned page to see if the login succeeded
   [ click through other links if required ]
   extract the logout link from the page
   use curl to fetch the logout page
   grep for something in the page to see if the logout succeeded

I'm definitely logging in to Siteminder sites and possibly Weblogic &
others.  Curl handles both https and http, goes through proxies,
handled NTLM & BasicAuith authentication, etc.

Ralph Mitchell
list Henrik Størner · Fri, 8 Dec 2006 14:29:17 +0100 ·
▸ quoted from Ralph Mitchell
On Fri, Dec 08, 2006 at 11:26:27AM +0100, user-bb3e9041f07f@xymon.invalid wrote:

I'm asking here if I can use Hobbit as a "probe" to test Internet sites. I 
want to be able to trace requests and provide to customers response time 
of these requests. Basically, the 'cont' test of Hobbit is not sufficient 
'cause you only test static pages. My main objective is to write some 
scenarios like : login with this login/pass / go to these links (trying to 
do some requests on Weblogic and database) / logout
I've done it for one or two sites, and abandoned it because it is
incredibly fragile when dealing with real-world websites. You're
basically going to mimic the behaviour of a browser, but you probably
don't have an engine that is fully capable of handling JavaScript,
cookies, automated redirects and form submissions like a real browser
does.

I did emulate a login to a web-based SAP system, and just the login
sequence ended up doing some 20-30 HTTP requests, because you got
bounced around webpages each of them setting a cookie, picking up a
form element, modifying a URL etc. 

If you must, then I'd suggest starting off with a network sniffer like
Ethereal (it has a new name now, I think), and then doing a trace of all
the requests that your browser performs. That will give you an idea of
how much work is involved, from the number of requests that actually go
out on the wire. Then you can start digging into each of the requests,
and see if you can automate them using some scripting tool.


Regards,
Henrik
list Gildas le Nadan · Fri, 08 Dec 2006 13:36:56 +0000 ·
▸ quoted from Henrik Størner
If you must, then I'd suggest starting off with a network sniffer like
Ethereal (it has a new name now, I think), and then doing a trace of all
the requests that your browser performs. That will give you an idea of
how much work is involved, from the number of requests that actually go
out on the wire. Then you can start digging into each of the requests,
and see if you can automate them using some scripting tool.
I would personally highly recommend ngrep and firefox's plugin 
livehttpheaders to trace the requests.

curl is your friend then.

Cheers
Gildas
list Ralph Mitchell · Fri, 8 Dec 2006 08:19:38 -0600 ·
▸ quoted from Henrik Størner
On 12/8/06, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
I've done it for one or two sites, and abandoned it because it is
incredibly fragile when dealing with real-world websites. You're
basically going to mimic the behaviour of a browser, but you probably
don't have an engine that is fully capable of handling JavaScript,
cookies, automated redirects and form submissions like a real browser
does.
Curl handles cookies, redirects that happen via Location headers, and
form submissions, for both regular sites and secure sites.

My scripts all evolved under Big Brother, so they're all Bourne shell,
using curl, grep, sed, head, tail, etc to process the pages.  There's
a perl script on the curl home page (http://curl.haxx.se) called
formfind.pl, which pulls out form elements.  I've got a hacked up copy
of formfind.pl that hands me the form in a format suitable for posting
back using curl.

I used to have a script that logged into an airline booking system,
picked out flights, and went through the whole booking sequence,
stopping right before it would have had to enter credit card details.
That was about 19 steps, I think.

You don't necessarily have to be able to process javascript.  A lot of
forms just use it to verify the data, which you can ignore.  I've run
into a few that used javascript to modify the form variables and store
the results into other form variables, but those aren't too hard to
deal with once you understand what's happening.

Probably the worst thing I've had to deal with was a page that
assembled a new url from bits of the form elements, then jumped to it
by setting location.href=[newurl].  That kind of thing almost has to
be hardwired, and as Henrik says, that has a tendency to be a bit
fragile.

I think I've got an example script somewhere.  If I can find it, I'll post it.

Ralph Mitchell
list Dan Vande More · Fri, 8 Dec 2006 08:29:38 -0600 · 
I've done many scripts like this in WWW::Automate using perl. That library
should be included with LWP::UserAgent.

It's quite reliable and very easy to use (assuming you know perl). I'd
highly recommend it to anyone seeking any sort of webautomation.
▸ quoted from Ralph Mitchell

On 12/8/06, Ralph Mitchell <user-00a5e44c48c0@xymon.invalid> wrote:
On 12/8/06, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
I've done it for one or two sites, and abandoned it because it is
incredibly fragile when dealing with real-world websites. You're
basically going to mimic the behaviour of a browser, but you probably
don't have an engine that is fully capable of handling JavaScript,
cookies, automated redirects and form submissions like a real browser
does.
Curl handles cookies, redirects that happen via Location headers, and
form submissions, for both regular sites and secure sites.

My scripts all evolved under Big Brother, so they're all Bourne shell,
using curl, grep, sed, head, tail, etc to process the pages.  There's
a perl script on the curl home page (http://curl.haxx.se) called
formfind.pl, which pulls out form elements.  I've got a hacked up copy
of formfind.pl that hands me the form in a format suitable for posting
back using curl.

I used to have a script that logged into an airline booking system,
picked out flights, and went through the whole booking sequence,
stopping right before it would have had to enter credit card details.
That was about 19 steps, I think.

You don't necessarily have to be able to process javascript.  A lot of
forms just use it to verify the data, which you can ignore.  I've run
into a few that used javascript to modify the form variables and store
the results into other form variables, but those aren't too hard to
deal with once you understand what's happening.

Probably the worst thing I've had to deal with was a page that
assembled a new url from bits of the form elements, then jumped to it
by setting location.href=[newurl].  That kind of thing almost has to
be hardwired, and as Henrik says, that has a tendency to be a bit
fragile.

I think I've got an example script somewhere.  If I can find it, I'll post
it.

Ralph Mitchell
list Thomas Seglard · Fri, 8 Dec 2006 15:49:27 +0100 · 
Thanks all for your answers and good advices. I'm going to write some 
scripts with curl and send results back to my customers.
Ralph, if you can also post your script, it would be interesting to 
analyse it.
Best regards,

Thomas
(user-bb3e9041f07f@xymon.invalid)

"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid> a écrit sur 08/12/2006 15:19:38
▸ quoted from Dan Vande More
:

On 12/8/06, Henrik Stoerner <user-ce4a2c883f75@xymon.invalid> wrote:
I've done it for one or two sites, and abandoned it because it is
incredibly fragile when dealing with real-world websites. You're
basically going to mimic the behaviour of a browser, but you probably
don't have an engine that is fully capable of handling JavaScript,
cookies, automated redirects and form submissions like a real browser
does.
Curl handles cookies, redirects that happen via Location headers, and
form submissions, for both regular sites and secure sites.

My scripts all evolved under Big Brother, so they're all Bourne shell,
using curl, grep, sed, head, tail, etc to process the pages.  There's
a perl script on the curl home page (http://curl.haxx.se) called
formfind.pl, which pulls out form elements.  I've got a hacked up copy
of formfind.pl that hands me the form in a format suitable for posting
back using curl.

I used to have a script that logged into an airline booking system,
picked out flights, and went through the whole booking sequence,
stopping right before it would have had to enter credit card details.
That was about 19 steps, I think.

You don't necessarily have to be able to process javascript.  A lot of
forms just use it to verify the data, which you can ignore.  I've run
into a few that used javascript to modify the form variables and store
the results into other form variables, but those aren't too hard to
deal with once you understand what's happening.

Probably the worst thing I've had to deal with was a page that
assembled a new url from bits of the form elements, then jumped to it
by setting location.href=[newurl].  That kind of thing almost has to
be hardwired, and as Henrik says, that has a tendency to be a bit
fragile.

I think I've got an example script somewhere.  If I can find it, I'll 
post it.

Ralph Mitchell


Ce message (et toutes ses pieces jointes eventuelles) est confidentiel et etabli a l'intention exclusive de ses destinataires.
Toute utilisation de ce message non conforme a sa destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse.
L'internet ne permettant pas d'assurer l'integrite de ce message, CNP Assurances et ses filiales declinent toute responsabilite
au titre de ce message, s'il a ete altere, deforme ou falsifie.

*****

This message and any attachments (the "message") are confidential and intended solely for the addressees.
Any unauthorised use or dissemination is prohibited.
E-mails are susceptible to alteration.
Neither CNP Assurances nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified.
list Michael Nagel · Fri, 23 Feb 2007 14:27:21 +0100 · 
I have a mysterious constellation.

With one exception showing historical logs works fine.

Only one service for one host error an occurs (Premature end of script
headers).
The same service for another host works.

If I add --debug in the bb-histlog.sh, it works (and shows "Trying
header/footer file '/opt/hobbit/server/web/histlog_footer'").

So I played a litte with the hobbitsvc.c.
If I comment
	if (tstamp) xfree(tstamp);
in the function do_request, this one service for this one host works also!

My hobbit version is 4.2.0 with the all-in-one-Patch from Dec 15.

Michael