Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?

how to download files from the web

by Anonymous Monk
on Jun 27, 2000 at 23:55 UTC ( #20066=perlquestion: print w/replies, xml ) Need Help??

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Is it possible to write a Perl script to download files from a certain web-page, one which I have to log into?
Thanks very much

Replies are listed 'Best First'.
Re: how to download files from the web
by le (Friar) on Jun 28, 2000 at 00:00 UTC
    LWP::UserAgent should fit your needs.
Re: how to download files from the web
by btrott (Parson) on Jun 28, 2000 at 00:27 UTC
    Check out Bundle::LWP. It comes with lwp-request, which you should look at, because it has some good examples of, obviously, making web requests, but also of doing so with basic authentication schemes.
Re: how to download files from the web
by eduardo (Curate) on Jun 28, 2000 at 08:18 UTC
    I love questions like this ;) such a thinly veiled attempt at writing a porn grabber... dude, if you are on a unix machine just make your life easier and use wget ;) you'll be glad you did.
      Heh. I'm writing a similar script. A comic grabber. I know I can use wget. Think I'll try the LWP module 'cause I'm just crazy like that. =)
Re: how to download files from the web
by toadi (Chaplain) on Jun 28, 2000 at 18:11 UTC
    Like the dude said use wget on *nix machines...
    'cos I tried LWP and it's a bit slow for large thingies :-)

    My opinions may have changed,
    but not the fact that I am right

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://20066]
Approved by root
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others romping around the Monastery: (3)
As of 2020-07-08 00:45 GMT
Find Nodes?
    Voting Booth?

    No recent polls found