May have found the reason. The code you gave me works, but when I substitute my URL it does not save. I can goto the page in the browser, but cannot access through code. I get the 501 response code. It seems as though the site I am trying to pull from disables such a request. Does anyone know of a hack to get around this?
-kcella | [reply] |
Just throwing out a few possibilities:
-
You may be loading a page that contains FRAMES, and the image may have a URL relative to a different frame than you expect.
- The image may be Javascript-generated
- The URL you have may result in a REDIRECT that displays the final image (Update)
- The image may be over 4 Gb - IIS throws 501 errors in that case.
You may need to capture packets and/or view the page source to get more information about this problem. It would also help if you posted the image URL.
..."I don't know what the facts are but somebody's certainly going to sit down with him and find out what he knows that they may not know, and make sure he knows what they know that he may not know, and that's a good thing. I think it's a very constructive exchange," --Donald Rumsfeld
| [reply] |
In addition to NetWallah's suggestions, the site may also be blocking according to the referrer URL, or by the user-agent of the "browser", or possibly even by a cookie (if the image URL is that of a CGI script). Try this code (which is completely untested):
#!perl -w
use strict;
use LWP::UserAgent;
use HTTP::Request::Common;
my $url = 'http://www.server.com/path/to/image.gif';
my ($referer) = $url =~ m!^(https?://[^/]+/)!;
my $ua = LWP::UserAgent->new(
agent => 'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 4.0)',
cookie_jar => {}
);
# probably not needed, only needed if cookie is used
# to test for "real browser". highly unlikely, but you
# never know!
$ua->get($referer);
my $req = HTTP::Request->new( GET => $url );
$req->referer($referer);
print $ua->request($req)->content();
| [reply]
[d/l] |
Got the following message when trying to run saskaqueer's code:
LWP will support https URLs if the Crypt::SSLeay module is installed.
More information at <http://www.linpro.no/lwp/libwww-perl/README.SSL>.
I tried installing Crypt::SSLeay, but ppm3 does not have a win32 version.
As for NetWallah's suggestions, I have a direct URL to the image, so it is not in a frame. It is also under 4 MB, not generated by javascript and not beign re-directed. I can download it manually just fine. I would post the URL, but it would not help since it is part of a password protected site and it would just redirect you to a login.
| [reply] |
You never gave us the actual URL of the image you are trying to download so we are leading you blindly. This script works for me.
use strict;
use WWW::Mechanize;
my $local_image = './google.gif';
my $url = 'http://www.google.com/images/firefox/google.gif';
my $mech = WWW::Mechanize->new();
$mech->get( $url );
open (OUT, ">$local_image");
binmode OUT; # Windows only
print OUT $mech->content;
| [reply]
[d/l] |
I tried WWW::Mechanize and it gave me a blank image. There is something in the web server daemon that is preventing me from downloading through a request/response. I can only save off the image if I do it manually. I was able to save the image by using a hack solution with Win32::GuiTest. The module allows me to automate key presses as if I were typing them.
use Win32::GuiTest qw(SendKeys);
$IE->Navigate( $url );
<wait>
SendKeys("%f$path~");
I wish to revisit the OLE automation and ExecWB command. I don't understand why this does not work. The following snippet should work, but it never saves the image unless I show the dialog and select the path manually.
$IE->Navigate( $url );
while( $IE->{Busy} ) {
while($IE->SpinMessageLoop()) { select undef, undef, undef, 0.25; }
}
$var = Variant( VT_BSTR, "./image.jpg" );
# 4 = SAVE_AS; 3 = HIDE_DIALOG
$IE->ExecWB( 4,3,$var,undef );
PS: For some reason I can't see my last post, so here it is again:
Got the following message when trying to run saskaqueer's code:
LWP will support https URLs if the Crypt::SSLeay module is installed. More information at <http://www.linpro.no/lwp/libwww-perl/README.SSL>.
I tried installing Crypt::SSLeay, but ppm3 does not have a win32 version. As for NetWallah's suggestions, I have a direct URL to the image, so it is not in a frame. It is also under 4 MB, not generated by javascript and not beign re-directed. I can download it manually just fine. I would post the URL, but it would not help since it is part of a password protected site and it would just redirect you to a login.
| [reply]
[d/l]
[select] |
