LWP not working with HTTPS protocol (SOLVED)

CountZero has asked for the wisdom of the Perl Monks concerning the following question:

Brothers & Sisters in Perl,

I was writing some code to access my Flickr account, when I happened to have to access a resource over an SSL connection (https-protocol).

Much to my surprise, LWP failed to access this resource and gave me a most strange error:

Can't connect to api.flickr.com:443
Bad file descriptor at d:/Perl/perl/site/lib/LWP/Protocol/http.pm line
+ 41.
[download]

The code I used was a very simple

my $ua = LWP::UserAgent->new;
my $req = HTTP::Request->new( GET => 'https://api.flickr.com/services/
+rest');
my $response = $ua->request($req);
[download]

Note that LWP makes the connection if I change 'https' by 'http'. Of course the webserver then refuses to return the requested resource as it requires an SSL connection.

Note also that the error message refers to the LWP::Protocol::http-module, rather than the LWP::Protocol::https-module, as one should expect.

Both modules are installed and up-to-date. Net::SSL is also installed and up-to-date (version 2.86).

I am running Strawberry Perl 18.2 on a Windows 8.1 machine.

Anyone any ideas how to make this work?

Update: Adding the ssl_opts and protocols_allowed parameters solved the problem. Thanks all!

CountZero

A program should be light and agile, its subroutines connected like a string of pearls. The spirit and intent of the program should be retained throughout. There should be neither too little or too much, neither needless loops nor useless variables, neither lack of structure nor overwhelming rigidity." - The Tao of Programming, 4.1 - Geoffrey James

My blog: Imperial Deltronics

Comment on LWP not working with HTTPS protocol (SOLVED) Select or Download Code

Replies are listed 'Best First'.
Re: LWP not working with HTTPS protocol by LanX (Saint) on May 02, 2015 at 22:27 UTC
I remember similar problems (though under Linux) cause https is checking certificates. Did you set the necessary environment variables? does this help? http://stackoverflow.com/questions/74358/how-can-i-get-lwp-to-validate-ssl-server-certificates Cheers Rolf _{(addicted to the Perl Programming Language and ☆☆☆☆ :) Je suis Charlie!}	[reply]
Re: LWP not working with HTTPS protocol by hippo (Bishop) on May 03, 2015 at 10:33 UTC
The following complete code works fine for me: `use strict; use warnings; use LWP::UserAgent; use HTTP::Request; my $ua = LWP::UserAgent->new; my $req = HTTP::Request->new( GET => 'https://api.flickr.com/services/ +rest'); my $response = $ua->request($req); print $response->code . "\n";` [download] And gives the expected "200" as output. LWP::UserAgent 6.02, HTTP::Request 6.00, LWP::Protocol::https 6.02, Mozilla::CA 20110914, perl 5.14.3 on Linux. Hope this is useful.	[reply] [d/l]
Re: LWP not working with HTTPS protocol by Khen1950fx (Canon) on May 03, 2015 at 04:00 UTC
Just FYI, I've noticed that the first test of LWP::Protocol::https fails because sometimes, when it tries to connect to the Apache Software Foundation, it connects ok; sometimes, it can't make a connection. For example, I installed it on 5.8.8 with no problems. A couple of hours later, I tried it on 5.16.0, but it couldn't connect. It seems the site is up and down frequently. The modules are installed, so they should just work. I think that LWP needs to be told to do https, at least in this situation: `#!/usr/bin/perl -l use strict; use warnings; use LWP::UserAgent; my $ua = LWP::UserAgent->new( ssl_opts => { verify_hostname => 0 }, protocols_allowed => ['https'], ); my $req = HTTP::Request->new( GET => 'https://api.flickr.com/services/rest', ); my $res = $ua->request($req); print $res->code;` [download]	[reply] [d/l]
Re^2: LWP not working with HTTPS protocol by noxxi (Pilgrim) on May 03, 2015 at 12:45 UTC
Please don't disable hostname validation, at least not with any code used in production. This makes you vulnerable to man-in-the-middle attacks.	[reply]
Re: LWP not working with HTTPS protocol by Gangabass (Vicar) on May 03, 2015 at 04:10 UTC
`LWP` uses `IO::Socket::SSL` since version 6.0 as the backend SSL library. So you need to update this module.	[reply] [d/l] [select]
Re^2: LWP not working with HTTPS protocol by Anonymous Monk on Jul 22, 2015 at 01:13 UTC
The problem still occurs with the latest IO::Socket::SSL (2.016) on Windows 8.1. `C:\Users\Jason\Development>cpan install IO::Socket::SSL CPAN: Term::ANSIColor loaded ok (v4.03) CPAN: Storable loaded ok (v2.51) Reading 'C:\Perl64\cpan\Metadata' Database was generated on Tue, 21 Jul 2015 05:41:02 GMT CPAN: Module::CoreList loaded ok (v5.20150720) IO::Socket::SSL is up to date (2.016).` [download]	[reply] [d/l]


No such thing as a small change
	PerlMonks