http://qs321.pair.com?node_id=50826

electronicMacks has asked for the wisdom of the Perl Monks concerning the following question:

Fellow Monks:

I am trying to use LWP to retrieve https pages with no success, and I cannot determine if the problem is with my code or my server environment. My Red Hat server does have LWP::Protocol::https installed, as well as openSSL, and I can successfully retrieve non-secure pages (such as http://www.perlmonks.org) but trying to retrieve https pages returns various errors, depending on what page I attempt.

For example, a query on
https://www.performancebike.com/checkout/checkout_billto.html
returns a 408 - User-agent timeout error, while a query on
https://www.goto.com/s/dtc/simple-signup/
returns a 500 - Unexpected EOF error, and a query on
https://marx.aztronic.com/index.html
returns a 400 - Bad Request

Here is my code:
#!/usr/bin/perl -w use strict; use LWP::Simple; use LWP::UserAgent; use LWP::Protocol::https; #my $url = "https://marx.aztronic.com/index.html"; #my $url = "https://www.performancebike.com/checkout/checkout_billto.h +tml"; my $url = "https://www.goto.com/s/dtc/simple-signup/"; #my $url = "http://www.perlmonks.org"; my $ua = new LWP::UserAgent; my $request = new HTTP::Request GET=> $url; my $page = $ua->request($request); if ($page->is_success) { print $page->content; } else { print $page->error_as_HTML; }

Do any monks know what could be causing all these varied errors and what I should change in my code or my server to fix it?

Humbly,
eMacks

Replies are listed 'Best First'.
Re: use LWP::Protocol::https
by lhoward (Vicar) on Jan 10, 2001 at 05:09 UTC
    When I run your code on my server it works just fine. Make sure you have the latest versions of all relevant LWP and HTTPS modules and OpenSSL.