small small script using WWW::Mechanize

madM has asked for the wisdom of the Perl Monks concerning the following question:

Hi Monks! I´m learning how to use WWW::Mechanize for scraping the Web and i was trying to get a URL from the web page https://www.google.de/ but unfortunately without succes .. any suggeestions? and maybe someone knows some tutorial where you can learn to become an expert in WWW::Mechanize

my $url = 'https://www.google.de/';
my $m->get($url);
my $link = $m->find_link(text => 'Bilder');
print "The Google Bilder search URL is: $link->url()\n";
[download]

Comment on small small script using WWW::Mechanize Download Code

Replies are listed 'Best First'.
Re: small small script using WWW::Mechanize by atcroft (Abbot) on Sep 18, 2013 at 01:23 UTC
First of all, I would caution that it may be against Google.de's Terms of Service to scrape results. Before proceeding, please verify that you are not in violation. That said, have you looked at the WWW::Mechanize::Cookbook and WWW::Mechanize::Examples? Also, have you looked at the data from the request (through the various dump_* methods) to be sure what you are getting back is what you expect? Hope that helps.	[reply]
Re^2: small small script using WWW::Mechanize by madM (Beadle) on Sep 18, 2013 at 01:37 UTC
thanks for your warning! but im not trying to scrap google results .. i use it only as example.. and thanks for WWW::Mechanize::Examples and Cookbook! :)	[reply]
Re^3: small small script using WWW::Mechanize by Anonymous Monk on Sep 18, 2013 at 03:19 UTC
i use it only as example There is an official url for that, http://example.com , its one of the official example hostnames :)	[reply]
Re: small small script using WWW::Mechanize by Khen1950fx (Canon) on Sep 18, 2013 at 01:17 UTC
You almost had it: `#!/usr/bin/perl -l use strict; use warnings; use WWW::Mechanize; my $url = 'https://www.google.de/'; my $agent = WWW::Mechanize->new; my $response = $agent->get($url); my $link = $agent->find_link( text => 'Bilder' ); print "The Google Bilder search URL is: ", Dumper ( $link->url );` [download]	[reply] [d/l]
Re^2: small small script using WWW::Mechanize by madM (Beadle) on Sep 18, 2013 at 01:35 UTC
thanks a lot! :)	[reply]


Just another Perl shrine
	PerlMonks