authenticate module

[Raghupathy]

Hi,

I like to use WWW::Mechanize to scrape a website.
However the website has a authentication page. Is
there a perl module I can use to perform the
authentication ?

Thanks,
Raghu

__________________________________
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software
[url]http://sitebuilder.yahoo.com[/url]

[R. Joseph Newton]

Raghupathy wrote:

> Hi,
>
> I like to use WWW::Mechanize to scrape a website.
> However the website has a authentication page. Is
> there a perl module I can use to perform the
> authentication ?
>
> Thanks,
> Raghu

Do you have the authors permission to scrape? It is possible that
they want to make their material accesible only to those who care
enough to visit in person.

Joseph

[Rob Hanson]

No extra module is needed. WWW::Mechanize is a subclass of LWP::UserAgent,
which supports it.

my $ua = new WWW::Mechanize();

$ua->credentials('www.myhostname.com:80', 'RealmName', 'user', 'pass');
$ua->get('http://www.myhostname.com');
print $ua->content;

The params are host/port, realm, username, password.

The realm should be visible in the login box (in IE6 it is).

See LWP::UserAgent for more info... although it doesn't say much about that
function.

Rob


-----Original Message-----
From: Raghupathy [mailto:rr_raghupathy@yahoo.com]
Sent: Monday, September 08, 2003 5:44 PM
To: [email]beginners@perl.org[/email]
Subject: authenticate module


Hi,

I like to use WWW::Mechanize to scrape a website.
However the website has a authentication page. Is
there a perl module I can use to perform the
authentication ?

Thanks,
Raghu

__________________________________
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software
[url]http://sitebuilder.yahoo.com[/url]

--
To unsubscribe, e-mail: [email]beginners-unsubscribe@perl.org[/email]
For additional commands, e-mail: [email]beginners-help@perl.org[/email]

[Raghupathy]

Thanks Rob...

Joseph,
I am trying to scrape a website for which I have
paid to look at the data. However since it is
currently time consuming, I like to parse the data
using perl to present it in a condensed form for my
personal use. None of the data will be published and
so I assume I do not need the owner permission to do
so.

Thanks,
Ramesh

--- "Hanson, Rob" <rhanson@aptegrity.com> wrote:

> No extra module is needed. WWW::Mechanize is a
> subclass of LWP::UserAgent,
> which supports it.
>
> my $ua = new WWW::Mechanize();
>
> $ua->credentials('www.myhostname.com:80',
> 'RealmName', 'user', 'pass');
> $ua->get('http://www.myhostname.com');
> print $ua->content;
>
> The params are host/port, realm, username, password.
>
> The realm should be visible in the login box (in IE6
> it is).
>
> See LWP::UserAgent for more info... although it
> doesn't say much about that
> function.
>
> Rob
>
>
> -----Original Message-----
> From: Raghupathy [mailto:rr_raghupathy@yahoo.com]
> Sent: Monday, September 08, 2003 5:44 PM
> To: [email]beginners@perl.org[/email]
> Subject: authenticate module
>
>
> Hi,
>
> I like to use WWW::Mechanize to scrape a website.
> However the website has a authentication page. Is
> there a perl module I can use to perform the
> authentication ?
>
> Thanks,
> Raghu
>
> __________________________________
> Do you Yahoo!?
> Yahoo! SiteBuilder - Free, easy-to-use web site
> design software
> [url]http://sitebuilder.yahoo.com[/url]
>
> --
> To unsubscribe, e-mail:
> [email]beginners-unsubscribe@perl.org[/email]
> For additional commands, e-mail:

[email]beginners-help@perl.org[/email]


__________________________________
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software
[url]http://sitebuilder.yahoo.com[/url]