Xymon Mailing List Archive search

URLplus

12 messages in this thread

list Thomas Laurids Pedersen · Tue, 29 Apr 2008 21:28:36 +0200 ·
Can this new extension do the post like the builtin http test can do ?

Regards, Thomas
list Ralph Mitchell · Tue, 29 Apr 2008 15:04:59 -0500 ·
On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid>
quoted from Thomas Laurids Pedersen
wrote:
Can this new extension do the post like the builtin http test can do ?

Regards, Thomas
I don't think so, as it currently stands.  This line:

   $ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);

in showUrl is the bit that actually fetches the web page.  To do a POST
using curl, you would need to change that to:

   $ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);

with matching additions elsewhere to fill the $postArgs variable with
whatever you want to post.  If you're wanting to implement something that
performs a login, you'd probably want to track cookies as well.

I'm not much of a perl programmer, so I'm not confident about making such
changes.  On the other hand, I've done quite a lot of this in Bourne
shell...

Ralph Mitchell
list Thomas Laurids Pedersen · Wed, 30 Apr 2008 10:16:59 +0200 ·
Would you share the bourne script. I need something quickly for only 1 site
at the moment, so anything will do.

Regards, Thomas


             "Ralph Mitchell"                                              
             <ralphmitchell at gm                                             
             ail.com>                                                   To 
                                       user-ae9b8668bcde@xymon.invalid                      
             29-04-2008 22:04                                           cc 
                                                                           
                                                                   Subject 
             Please respond to         Re: [hobbit] URLplus                
              user-ae9b8668bcde@xymon.invalid                                               
quoted from Ralph Mitchell
                                                                           
                                                                           
On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid>
wrote:


      Can this new extension do the post like the builtin http test can do
      ?

      Regards, Thomas


I don't think so, as it currently stands.  This line:

   $ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);

in showUrl is the bit that actually fetches the web page.  To do a POST
using curl, you would need to change that to:

   $ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);

with matching additions elsewhere to fill the $postArgs variable with
whatever you want to post.  If you're wanting to implement something that
performs a login, you'd probably want to track cookies as well.

I'm not much of a perl programmer, so I'm not confident about making such
changes.  On the other hand, I've done quite a lot of this in Bourne
shell...

Ralph Mitchell
list Gary Baluha · Wed, 30 Apr 2008 10:12:40 -0400 ·
I have an updated version of URLPLus which supports single-form submissions.
I haven't gotten around to being able to submit directly to The Shire, so
I'm attaching it here.

I've also updated this to do multi-page checking (i.e. full "end-to-end"
transaction monitoring), but consider that feature mostly experimental at
this time.

On Wed, Apr 30, 2008 at 4:16 AM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid>
quoted from Thomas Laurids Pedersen
wrote:
Would you share the bourne script. I need something quickly for only 1
site at the moment, so anything will do.

Regards, Thomas

[image: Inactive hide details for "Ralph Mitchell"
<user-00a5e44c48c0@xymon.invalid>]"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>


    *"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>*

            29-04-2008 22:04
            Please respond to
            user-ae9b8668bcde@xymon.invalid


To

user-ae9b8668bcde@xymon.invalid
cc


Subject

Re: [hobbit] URLplus

On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <*user-934e986710b3@xymon.invalid*<user-934e986710b3@xymon.invalid>>
quoted from Thomas Laurids Pedersen
wrote:

   Can this new extension do the post like the builtin http test can do
      ?

      Regards, Thomas


I don't think so, as it currently stands. This line:

$ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);

in showUrl is the bit that actually fetches the web page. To do a POST
using curl, you would need to change that to:

$ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);

with matching additions elsewhere to fill the $postArgs variable with
whatever you want to post. If you're wanting to implement something that
performs a login, you'd probably want to track cookies as well.

I'm not much of a perl programmer, so I'm not confident about making such
changes. On the other hand, I've done quite a lot of this in Bourne shell...

Ralph Mitchell
list Ralph Mitchell · Wed, 30 Apr 2008 12:28:46 -0500 ·
Unfortunately it's not just one script.  I've found many variations in login
pages, so I've had to customize the scripts for each different target.  Some
logins require a form to be posted back, others are handled via
WWW-Authenticate pop-up boxes and sometimes redirects have to be followed.
That's not hard if the site uses Location headers, because curl can handle
those, but I've also found meta-refresh tags and several types of javascript
"go-elsewhere" redirects that have to be individually scripted.

I posted something a year or so ago that might get you started.  If I can
find it, I'll post it again.

Ralph Mitchell


On Wed, Apr 30, 2008 at 3:16 AM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid>
quoted from Gary Baluha
wrote:
 Would you share the bourne script. I need something quickly for only 1
site at the moment, so anything will do.

Regards, Thomas

[image: Inactive hide details for "Ralph Mitchell"
<user-00a5e44c48c0@xymon.invalid>]"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>


    *"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>*

            29-04-2008 22:04
            Please respond to
            user-ae9b8668bcde@xymon.invalid


To

user-ae9b8668bcde@xymon.invalid
cc


Subject

Re: [hobbit] URLplus

On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <*user-934e986710b3@xymon.invalid*<user-934e986710b3@xymon.invalid>>
wrote:

   Can this new extension do the post like the builtin http test can do
      ?

      Regards, Thomas


I don't think so, as it currently stands. This line:

$ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);

in showUrl is the bit that actually fetches the web page. To do a POST
using curl, you would need to change that to:

$ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);

with matching additions elsewhere to fill the $postArgs variable with
whatever you want to post. If you're wanting to implement something that
performs a login, you'd probably want to track cookies as well.

I'm not much of a perl programmer, so I'm not confident about making such
changes. On the other hand, I've done quite a lot of this in Bourne shell...

Ralph Mitchell
list Gary Baluha · Wed, 30 Apr 2008 13:35:14 -0400 ·
On Wed, Apr 30, 2008 at 1:28 PM, Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
quoted from Ralph Mitchell
wrote:
Unfortunately it's not just one script.  I've found many variations in
login pages, so I've had to customize the scripts for each different
target.  Some logins require a form to be posted back, others are handled
via WWW-Authenticate pop-up boxes and sometimes redirects have to be
followed.  That's not hard if the site uses Location headers, because curl
can handle those, but I've also found meta-refresh tags and several types of
javascript "go-elsewhere" redirects that have to be individually scripted.

And these are some of the same issues I've run in to while writing the
URLPlus script.  I've been trying to slowly morph it into something that can
configured solely through the configuration file without having to change
any code, but that's easier said than done.  Especially since the original
reason I was writing the script got removed, and is supposed to be converted
to yet another monitoring system (which so far hasn't progressed, probably
because of the fact that some of the monitors are non-trivial).
quoted from Ralph Mitchell

I posted something a year or so ago that might get you started.  If I can
find it, I'll post it again.

Ralph Mitchell


On Wed, Apr 30, 2008 at 3:16 AM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid>
wrote:
 Would you share the bourne script. I need something quickly for only 1
site at the moment, so anything will do.

Regards, Thomas

[image: Inactive hide details for "Ralph Mitchell"
<user-00a5e44c48c0@xymon.invalid>]"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>


    *"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>*

            29-04-2008 22:04
            Please respond to
            user-ae9b8668bcde@xymon.invalid


To

user-ae9b8668bcde@xymon.invalid
cc


Subject

Re: [hobbit] URLplus

On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <*user-934e986710b3@xymon.invalid*<user-934e986710b3@xymon.invalid>>
wrote:

   Can this new extension do the post like the builtin http test can
      do ?

      Regards, Thomas


I don't think so, as it currently stands. This line:

$ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);

in showUrl is the bit that actually fetches the web page. To do a POST
using curl, you would need to change that to:

$ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);

with matching additions elsewhere to fill the $postArgs variable with
whatever you want to post. If you're wanting to implement something that
performs a login, you'd probably want to track cookies as well.

I'm not much of a perl programmer, so I'm not confident about making
such changes. On the other hand, I've done quite a lot of this in Bourne
shell...

Ralph Mitchell
list Ralph Mitchell · Wed, 30 Apr 2008 13:34:47 -0500 ·
quoted from Gary Baluha
On Wed, Apr 30, 2008 at 12:35 PM, Gary Baluha <user-ae3e15c22de1@xymon.invalid> wrote:
On Wed, Apr 30, 2008 at 1:28 PM, Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
wrote:
Unfortunately it's not just one script.  I've found many variations in
login pages, so I've had to customize the scripts for each different
target.  Some logins require a form to be posted back, others are handled
via WWW-Authenticate pop-up boxes and sometimes redirects have to be
followed.  That's not hard if the site uses Location headers, because curl
can handle those, but I've also found meta-refresh tags and several types of
javascript "go-elsewhere" redirects that have to be individually scripted.

And these are some of the same issues I've run in to while writing the
URLPlus script.  I've been trying to slowly morph it into something that can
configured solely through the configuration file without having to change
any code, but that's easier said than done.  Especially since the original
reason I was writing the script got removed, and is supposed to be converted
to yet another monitoring system (which so far hasn't progressed, probably
because of the fact that some of the monitors are non-trivial).
Seems like we have a "get-rid-of-Hobbit" project about every 2 years or so.


I think our National Tools Team has some kind of click-through tools that
records page requests, but  I'm pretty sure it doesn't do too well with
forms that include some variable(s) sent back by the server.  For example,
one thing I've seen is a form variable called __VIEWSTATE that seems to get
a new, longer value with each successive page loaded.  I've no idea what the
value is as it's encoded some way, but I suppose it tracks where you are in
the page.

I don't think the script recorder can handle variable inputs either.  I'm
watching a number of web pages where I have to enter a date that's days or
weeks ahead of today's date.  The recorder will just see the post containing
the future date and faithfully re-post it every time, right up until it
becomes a past date and the monitor breaks...

I won't be too surprised if in the end I get to keep my scripts, but I'll
probably have to send traps to Unicenter as well as sending Hobbit reports.
That way the "best shore" eyes-on-glass folks in Brazil or Singapore or
wherever won't have to deal with Hobbit, while the 2nd-level folks at home
still get the detail they're used to.

In the meantime, attached are the two files I sent previously, on 6/23/06.
Here's what I wrote then:


bb-siteminder.sh is an example script to demonstrate how to login
formextract.pl is a slightly modified copy of Daniel Stenberg's
formfind.pl, which can be found here:

   http://curl.haxx.se/docs/programs.html

I'm not a perl programmer, so any screwups in formextract are mine, not
Daniel's... :)

It's doubtful that the example script will work out of the box.  I've
found that I generally have to take it in easy stages - fetch the first
page, eyeball it, adjust the script, lather, rinse, repeat.
LiveHTTPHeaders is a really useful Firefox extension for tracking what
happens when navigating web pages.

Ralph Mitchell
Attachments (2)
list Scott Walters · Wed, 30 Apr 2008 22:35:39 -0400 ·
On Wed, Apr 30, 2008 at 2:34 PM, Ralph Mitchell <user-00a5e44c48c0@xymon.invalid>
quoted from Ralph Mitchell
wrote:
On Wed, Apr 30, 2008 at 12:35 PM, Gary Baluha <user-ae3e15c22de1@xymon.invalid> wrote:
I'm not a perl programmer, so any screwups in formextract are mine, not
Daniel's... :)

It's doubtful that the example script will work out of the box.  I've
found that I generally have to take it in easy stages - fetch the first
page, eyeball it, adjust the script, lather, rinse, repeat.
LiveHTTPHeaders is a really useful Firefox extension for tracking what
happens when navigating web pages.
http://search.cpan.org/~ilyam/HTTP-WebTest-2.04/  is a really nice perl
module for writing more complex http testing parameters.  It even has the
ability to generate Test::Harness output.

-Scott
list Massimo Morsiani · Mon, 22 Jun 2009 10:59:47 +0200 ·
Hi Gary,
 
is there any new URLPlus version?
I'm currently using v1.21 ($Id: url-plus.pl,v 1.21 2008/04/30 13:56:07).
 
Thanks.
 
 
Regards.
 
Massimo Morsiani 
Information Technology Dept. 
Gilbarco S.r.l. 
via de' Cattani, 220/G 
50145 Firenze, Italy 
tel:    +XX-XXX-XXXXX 
fax:    +XX-XXX-XXXXXX 
email:  user-32025d8bd22e@xymon.invalid 
web:    http://www.gilbarco.it <http://www.gilbarco.it/>;  
quoted from Gary Baluha


From: Gary Baluha [mailto:user-ae3e15c22de1@xymon.invalid] 
Sent: mercoledì 30 aprile 2008 16.13
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] URLplus


I have an updated version of URLPLus which supports single-form submissions.
I haven't gotten around to being able to submit directly to The Shire, so I'm attaching it here.  

I've also updated this to do multi-page checking (i.e. full "end-to-end" transaction monitoring), but consider that feature mostly experimental at this time.


On Wed, Apr 30, 2008 at 4:16 AM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid> wrote:


	Would you share the bourne script. I need something quickly for only 1 site at the moment, so anything will do.
	
	Regards, Thomas
	
	 "Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>
	
	
				"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid> 

				29-04-2008 22:04 

	
	Please respond to
user-ae9b8668bcde@xymon.invalid

 
To

user-ae9b8668bcde@xymon.invalid	


cc

	
Subject

Re: [hobbit] URLplus	
	 	

	On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid <mailto:user-934e986710b3@xymon.invalid> > wrote: 

			Can this new extension do the post like the builtin http test can do ?
			
			Regards, Thomas

	
	I don't think so, as it currently stands. This line:
	
	$ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);
	
	in showUrl is the bit that actually fetches the web page. To do a POST using curl, you would need to change that to:
	
	$ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);
	
	with matching additions elsewhere to fill the $postArgs variable with whatever you want to post. If you're wanting to implement something that performs a login, you'd probably want to track cookies as well.
	
	I'm not much of a perl programmer, so I'm not confident about making such changes. On the other hand, I've done quite a lot of this in Bourne shell...
	
	Ralph Mitchell
	

Please be advised that this email may contain confidential information.
 If you are not the intended recipient, please do not read, copy or
re-transmit this email.  If you have received this email in error,
please notify us by email by replying to the sender and by telephone
(call us collect at +X XXX-XXX-XXXX) and delete this message and any
attachments.  Thank you in advance for your cooperation and assistance.

In addition, Danaher and its subsidiaries disclaim that the content of
this email constitutes an offer to enter into, or the acceptance of, 
any
contract or agreement or any amendment thereto; provided that the
foregoing disclaimer does not invalidate the binding effect of any
digital or other electronic reproduction of a manual signature that is
included in any attachment to this email.
list Gary Baluha · Tue, 23 Jun 2009 10:19:44 -0400 ·
I haven't checked The Shire in a while, but I think it still has an older
version.  I personally haven't been working on URLPlus for a few months
(actually, I left the company I was using the script at), but a former
coworker of mine has taken the task of updating the code.  I will check with
him to see where he's at. Also, I do plan on getting back to developing it,
hopefully in the near future (sometime later this year).

On Mon, Jun 22, 2009 at 4:59 AM, Morsiani, Massimo <
quoted from Massimo Morsiani
user-32025d8bd22e@xymon.invalid> wrote:
 Hi Gary,

is there any new URLPlus version?
I'm currently using v1.21 ($Id: url-plus.pl,v 1.21 2008/04/30 13:56:07).

Thanks.


Regards.

Massimo Morsiani
Information Technology Dept.
Gilbarco S.r.l.
via de' Cattani, 220/G
50145 Firenze, Italy
tel:    +XX-XXX-XXXXX
fax:    +XX-XXX-XXXXXX
email:  user-32025d8bd22e@xymon.invalid
web:    http://www.gilbarco.it

*From:* Gary Baluha [mailto:user-ae3e15c22de1@xymon.invalid]
*Sent:* mercoledì 30 aprile 2008 16.13
*To:* user-ae9b8668bcde@xymon.invalid
*Subject:* Re: [hobbit] URLplus

I have an updated version of URLPLus which supports single-form
submissions.
I haven't gotten around to being able to submit directly to The Shire, so
I'm attaching it here.

I've also updated this to do multi-page checking (i.e. full "end-to-end"
transaction monitoring), but consider that feature mostly experimental at
this time.

On Wed, Apr 30, 2008 at 4:16 AM, Thomas Laurids Pedersen <user-934e986710b3@xymon.invalid>
wrote:
 Would you share the bourne script. I need something quickly for only 1
site at the moment, so anything will do.

Regards, Thomas

[image: Inactive hide details for "Ralph Mitchell"
<user-00a5e44c48c0@xymon.invalid>]"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>


    *"Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>*

            29-04-2008 22:04
              Please respond to
            user-ae9b8668bcde@xymon.invalid


To

user-ae9b8668bcde@xymon.invalid
cc


Subject

Re: [hobbit] URLplus

On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen <*user-934e986710b3@xymon.invalid*<user-934e986710b3@xymon.invalid>>
wrote:

   Can this new extension do the post like the builtin http test can do ?

      Regards, Thomas


I don't think so, as it currently stands. This line:

$ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);

in showUrl is the bit that actually fetches the web page. To do a POST
using curl, you would need to change that to:

$ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);

with matching additions elsewhere to fill the $postArgs variable with
whatever you want to post. If you're wanting to implement something that
performs a login, you'd probably want to track cookies as well.

I'm not much of a perl programmer, so I'm not confident about making such
changes. On the other hand, I've done quite a lot of this in Bourne shell...

Ralph Mitchell
 Please be advised that this email may contain confidential information.
If you are not the intended recipient, please do not read, copy or
re-transmit this email. If you have received this email in error,
please notify us by email by replying to the sender and by telephone
(call us collect at +X XXX-XXX-XXXX) and delete this message and any
attachments. Thank you in advance for your cooperation and assistance.

In addition, Danaher and its subsidiaries disclaim that the content of
this email constitutes an offer to enter into, or the acceptance of,
any
contract or agreement or any amendment thereto; provided that the
foregoing disclaimer does not invalidate the binding effect of any
digital or other electronic reproduction of a manual signature that is
included in any attachment to this email.
list Darryl Wisneski · Tue, 23 Jun 2009 14:39:12 -0400 ·
quoted from Gary Baluha
On Tue, Jun 23, 2009 at 10:19:44AM -0400, Gary Baluha wrote:
   I haven't checked The Shire in a while, but I think it still has an
   older version.  I personally haven't been working on URLPlus for a few
   months (actually, I left the company I was using the script at), but a
   former coworker of mine has taken the task of updating the code.  I
   will check with him to see where he's at. Also, I do plan on getting
   back to developing it, hopefully in the near future (sometime later
   this year).
Massimo:

What exactly are you looking for out of urlplus?

I am working on changing urlplus to use libcurl instead of the using
the curl command line tool.  Some website monitoring I needed
involved using shared session data (in a nefarious cross-site
scripting way, but that is what our app was doing) and hitting
multiple links on a website with the same initial login authentication
session data.  You can only do the shared cookies/session stuff
with libcurl.

I am using a bare bones perl/libcurl script to do the aforementioned
monitoring now and have not yet plugged it into Gary's urlplus.
Furthermore, given the complexity of what I am trying to do with
shared session login the urlplus configuration file layout has to
be looked at again.

We'll keep the list posted on any progress.

Gary has a 1.22 version laying around but I am not sure what's
changed and it's a year old already.

Regards,
-dkw
quoted from Gary Baluha

   On Mon, Jun 22, 2009 at 4:59 AM, Morsiani, Massimo
   <[1]user-32025d8bd22e@xymon.invalid> wrote:

   Hi Gary,

   is there any new URLPlus version?
   I'm currently using v1.21 ($Id: url-plus.pl,v 1.21 2008/04/30
   13:56:07).

   Thanks.


   Regards.

   Massimo Morsiani
   Information Technology Dept.
   Gilbarco S.r.l.
   via de' Cattani, 220/G
   50145 Firenze, Italy
   tel:    +XX-XXX-XXXXX
   fax:    +XX-XXX-XXXXXX

   email:  [2]user-32025d8bd22e@xymon.invalid
   web:    [3]http://www.gilbarco.it
quoted from Gary Baluha

   From: Gary Baluha [mailto:[4]user-ae3e15c22de1@xymon.invalid]
   Sent: mercoled� 30 aprile 2008 16.13
   To: [5]user-ae9b8668bcde@xymon.invalid
   Subject: Re: [hobbit] URLplus
   I have an updated version of URLPLus which supports single-form
   submissions.
   I haven't gotten around to being able to submit directly to The Shire,
   so I'm attaching it here.
   I've also updated this to do multi-page checking (i.e. full
   "end-to-end" transaction monitoring), but consider that feature mostly
   experimental at this time.
   On Wed, Apr 30, 2008 at 4:16 AM, Thomas Laurids Pedersen
   <[6]user-934e986710b3@xymon.invalid> wrote:

   Would you share the bourne script. I need something quickly for only 1
   site at the moment, so anything will do.
   Regards, Thomas

   Inactive hide details for "Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>
   "Ralph Mitchell" <[7]user-00a5e44c48c0@xymon.invalid>

   "Ralph Mitchell" <[8]user-00a5e44c48c0@xymon.invalid>
       29-04-2008 22:04

                             Please respond to
                             [9]user-ae9b8668bcde@xymon.invalid

                                                                       To

   [10]user-ae9b8668bcde@xymon.invalid
quoted from Gary Baluha

                                                                       cc

                                                                  Subject

   Re: [hobbit] URLplus
   On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen
   <[11]user-934e986710b3@xymon.invalid> wrote:

   Can this new extension do the post like the builtin http test can do ?
       Regards, Thomas

   I don't think so, as it currently stands. This line:
   $ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);
   in showUrl is the bit that actually fetches the web page. To do a POST
   using curl, you would need to change that to:
   $ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);
   with matching additions elsewhere to fill the $postArgs variable with
   whatever you want to post. If you're wanting to implement something
   that performs a login, you'd probably want to track cookies as well.
   I'm not much of a perl programmer, so I'm not confident about making
   such changes. On the other hand, I've done quite a lot of this in
   Bourne shell...
   Ralph Mitchell

   Please be advised that this email may contain confidential
   information.
   If you are not the intended recipient, please do not read, copy or
   re-transmit this email. If you have received this email in error,
   please notify us by email by replying to the sender and by telephone
   (call us collect at +X XXX-XXX-XXXX) and delete this message and any
   attachments. Thank you in advance for your cooperation and assistance.
   In addition, Danaher and its subsidiaries disclaim that the content of
   this email constitutes an offer to enter into, or the acceptance of,
   any
   contract or agreement or any amendment thereto; provided that the
   foregoing disclaimer does not invalidate the binding effect of any
   digital or other electronic reproduction of a manual signature that is
   included in any attachment to this email.

References

   1. mailto:user-32025d8bd22e@xymon.invalid
   2. mailto:user-32025d8bd22e@xymon.invalid
   3. http://www.gilbarco.it/
   4. mailto:user-ae3e15c22de1@xymon.invalid
   5. mailto:user-ae9b8668bcde@xymon.invalid
   6. mailto:user-934e986710b3@xymon.invalid
   7. mailto:user-00a5e44c48c0@xymon.invalid
   8. mailto:user-00a5e44c48c0@xymon.invalid
   9. mailto:user-ae9b8668bcde@xymon.invalid
  10. mailto:user-ae9b8668bcde@xymon.invalid
  11. mailto:user-934e986710b3@xymon.invalid
list Massimo Morsiani · Thu, 25 Jun 2009 19:20:11 +0200 ·
Hi Darryl,

I'm interested in 
- go to a web page
- insert username/password to login
- surf the web site following specific links
- grab some data from a specific web page
- check the grabbed data (ie if GRABBED_DATA < MY_THRESHOLD then alert)
quoted from Darryl Wisneski

Thanks.


Regards.

Massimo Morsiani
Information Technology Dept.
Gilbarco S.r.l.
via de' Cattani, 220/G
50145 Firenze, Italy
tel:	+XX-XXX-XXXXX
fax:	+XX-XXX-XXXXXX
email:	user-32025d8bd22e@xymon.invalid
web:	http://www.gilbarco.it


-----Original Message-----
From: Darryl Wisneski [mailto:user-d4910417b71d@xymon.invalid] 
Sent: martedì 23 giugno 2009 20.39
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] URLplus

On Tue, Jun 23, 2009 at 10:19:44AM -0400, Gary Baluha wrote:
   I haven't checked The Shire in a while, but I think it still has an
   older version.  I personally haven't been working on URLPlus for a few
   months (actually, I left the company I was using the script at), but a
   former coworker of mine has taken the task of updating the code.  I
   will check with him to see where he's at. Also, I do plan on getting
   back to developing it, hopefully in the near future (sometime later
   this year).
Massimo:

What exactly are you looking for out of urlplus?

I am working on changing urlplus to use libcurl instead of the using the curl command line tool.  Some website monitoring I needed involved using shared session data (in a nefarious cross-site scripting way, but that is what our app was doing) and hitting multiple links on a website with the same initial login authentication session data.  You can only do the shared cookies/session stuff with libcurl.

I am using a bare bones perl/libcurl script to do the aforementioned monitoring now and have not yet plugged it into Gary's urlplus.
Furthermore, given the complexity of what I am trying to do with shared session login the urlplus configuration file layout has to be looked at again.

We'll keep the list posted on any progress.

Gary has a 1.22 version laying around but I am not sure what's changed and it's a year old already.

Regards,
-dkw

   On Mon, Jun 22, 2009 at 4:59 AM, Morsiani, Massimo
   <[1]user-32025d8bd22e@xymon.invalid> wrote:

   Hi Gary,

   is there any new URLPlus version?
   I'm currently using v1.21 ($Id: url-plus.pl,v 1.21 2008/04/30
   13:56:07).

   Thanks.


   Regards.

   Massimo Morsiani
   Information Technology Dept.
   Gilbarco S.r.l.
   via de' Cattani, 220/G
   50145 Firenze, Italy
   tel:    +XX-XXX-XXXXX
   fax:    +XX-XXX-XXXXXX
   email:  [2]user-32025d8bd22e@xymon.invalid
   web:    [3]http://www.gilbarco.it

   From: Gary Baluha [mailto:[4]user-ae3e15c22de1@xymon.invalid]
   Sent: mercoledì 30 aprile 2008 16.13
   To: [5]user-ae9b8668bcde@xymon.invalid
   Subject: Re: [hobbit] URLplus
   I have an updated version of URLPLus which supports single-form
   submissions.
   I haven't gotten around to being able to submit directly to The Shire,
   so I'm attaching it here.
   I've also updated this to do multi-page checking (i.e. full
   "end-to-end" transaction monitoring), but consider that feature mostly
   experimental at this time.
   On Wed, Apr 30, 2008 at 4:16 AM, Thomas Laurids Pedersen
   <[6]user-934e986710b3@xymon.invalid> wrote:

   Would you share the bourne script. I need something quickly for only 1
   site at the moment, so anything will do.
   Regards, Thomas
   Inactive hide details for "Ralph Mitchell" <user-00a5e44c48c0@xymon.invalid>
   "Ralph Mitchell" <[7]user-00a5e44c48c0@xymon.invalid>

   "Ralph Mitchell" <[8]user-00a5e44c48c0@xymon.invalid>
       29-04-2008 22:04

                             Please respond to
                             [9]user-ae9b8668bcde@xymon.invalid

                                                                       
To

   [10]user-ae9b8668bcde@xymon.invalid

                                                                       
cc

                                                                  
Subject

   Re: [hobbit] URLplus
   On Tue, Apr 29, 2008 at 2:28 PM, Thomas Laurids Pedersen
   <[11]user-934e986710b3@xymon.invalid> wrote:

   Can this new extension do the post like the builtin http test can do ?
       Regards, Thomas

   I don't think so, as it currently stands. This line:
   $ret=qx(curl -m $tout -s -k -S $pstr "$url" 2>&1);
   in showUrl is the bit that actually fetches the web page. To do a POST
   using curl, you would need to change that to:
   $ret=qx(curl -m $tout -s -k -S -d $postArgs $pstr "$url" 2>&1);
   with matching additions elsewhere to fill the $postArgs variable with
   whatever you want to post. If you're wanting to implement something
   that performs a login, you'd probably want to track cookies as well.
   I'm not much of a perl programmer, so I'm not confident about making
   such changes. On the other hand, I've done quite a lot of this in
   Bourne shell...
   Ralph Mitchell

   Please be advised that this email may contain confidential
   information.
   If you are not the intended recipient, please do not read, copy or
   re-transmit this email. If you have received this email in error,
   please notify us by email by replying to the sender and by telephone
   (call us collect at +X XXX-XXX-XXXX) and delete this message and any
   attachments. Thank you in advance for your cooperation and assistance.
   In addition, Danaher and its subsidiaries disclaim that the content of
   this email constitutes an offer to enter into, or the acceptance of,
   any
   contract or agreement or any amendment thereto; provided that the
   foregoing disclaimer does not invalidate the binding effect of any
   digital or other electronic reproduction of a manual signature that is
   included in any attachment to this email.

References

   1. mailto:user-32025d8bd22e@xymon.invalid
   2. mailto:user-32025d8bd22e@xymon.invalid
   3. http://www.gilbarco.it/
   4. mailto:user-ae3e15c22de1@xymon.invalid
   5. mailto:user-ae9b8668bcde@xymon.invalid
   6. mailto:user-934e986710b3@xymon.invalid
   7. mailto:user-00a5e44c48c0@xymon.invalid
   8. mailto:user-00a5e44c48c0@xymon.invalid
   9. mailto:user-ae9b8668bcde@xymon.invalid
  10. mailto:user-ae9b8668bcde@xymon.invalid
  11. mailto:user-934e986710b3@xymon.invalid

Please be advised that this email may contain confidential information.
 If you are not the intended recipient, please do not read, copy or
re-transmit this email.  If you have received this email in error,
please notify us by email by replying to the sender and by telephone
(call us collect at +X XXX-XXX-XXXX) and delete this message and any
attachments.  Thank you in advance for your cooperation and assistance.

In addition, Danaher and its subsidiaries disclaim that the content of
this email constitutes an offer to enter into, or the acceptance of, 
any
contract or agreement or any amendment thereto; provided that the
foregoing disclaimer does not invalidate the binding effect of any
digital or other electronic reproduction of a manual signature that is
included in any attachment to this email.