Re^4: Pulling a Page with LWP::UserAgent and fixing URLs?


more useful options
	PerlMonks

Re^4: Pulling a Page with LWP::UserAgent and fixing URLs?

by MrForsythExeter (Novice)

on Nov 09, 2004 at 15:08 UTC ( [id://406354]=note: print w/replies, xml )

Need Help??

in reply to Re^3: Pulling a Page with LWP::UserAgent and fixing URLs?
in thread Pulling a Page with LWP::UserAgent and fixing URLs?

URI::URL is only used for old stuff.. backward compatibility and all that, Looks like URI is the one, however using this are you saying i should parse out all the URL's and then use this to fix them and put them in.. or could i do a regexp with /e on the end and do it all in one line?

Comment on Re^4: Pulling a Page with LWP::UserAgent and fixing URLs?

Replies are listed 'Best First'.

Re^5: Pulling a Page with LWP::UserAgent and fixing URLs?
by teabag (Pilgrim) on Nov 10, 2004 at 14:30 UTC

http://perl.com

#!/usr/bin/perl
use strict;
use warnings;
use LWP;
use URI;

  my $browser = LWP::UserAgent->new;

      my $url = 'http://www.cpan.org/RECENT.html';
        my $response = $browser->get($url);
          die "Can't get $url -- ", $response->status_line
             unless $response->is_success;

                 my $html = $response->content;
                   while( $html =~ m/<A HREF=\"(.*?)\"/g ) {
                         print URI->new_abs( $1, $response->base ) ,"\
+n";
                           }
[download]

teabag

-- Siggy Played Guitar

Sure there's more than one way, but one just needs one anyway - Teabag

[reply]
[d/l]

In Section Seekers of Perl Wisdom