Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid

Re: Downloading files from a Secured Site

by zentara (Archbishop)
on May 25, 2007 at 17:09 UTC ( #617548=note: print w/replies, xml ) Need Help??

in reply to Downloading files from a Secured Site

UPDATE: Fixed code to handle auth, my previous script was untested :-( Here is a simple way with progress( tested :-) ):
#!/usr/bin/perl -w #adapted from lwpcook use strict; use LWP::UserAgent; my $user = 'zentara'; my $pass = 'foobar'; my $ua = LWP::UserAgent->new; my $URL = ''; my $filename = substr( $URL, rindex( $URL, "/" ) + 1 ); #print "$filename\n"; open( IN, ">$filename" ) or die $!; print "Fetching $URL\n"; my $expected_length; my $bytes_received = 0; my $req = HTTP::Request->new(GET => $URL); $req->authorization_basic($user, $pass); my $res = $ua->request($req, sub { my ( $chunk, $res ) = @_; $bytes_received += length($chunk); unless ( defined $expected_length ) { $expected_length = $res->content_length || 0; } if ($expected_length) { printf STDERR "%d%% - ", 100 * $bytes_received / $expected +_length; } print STDERR "$bytes_received bytes received\n"; # XXX Should really do something with the chunk itself print IN $chunk; } ); print $res->status_line, "\n"; close IN; exit;

I'm not really a human, but I play one on earth. Cogito ergo sum a bum

Replies are listed 'Best First'.
Re^2: Downloading files from a Secured Site
by wazoox (Prior) on May 25, 2007 at 20:08 UTC
    Thank you, very interesting piece :) It even owes a post of its own in the Code Catacombs!

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://617548]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others imbibing at the Monastery: (2)
As of 2021-04-17 18:13 GMT
Find Nodes?
    Voting Booth?

    No recent polls found