WWW::Mechanize and SSL

Jonathan has asked for the wisdom of the Perl Monks concerning the following question:

Firstly, apologies as this is more a SSL issue than just Perl. I have an HTTPS url that I want to pull some data from (the url is another server on our local network). The url works fine with Chrome, MS Edge etc but I'm getting a certificate error running my test script from a dev server (Ubuntu). Also wget also fails with certificate errors.

#!/usr/bin/perl
use strict;
use warnings;
use WWW::Mechanize;
use Net::SSLeay;

my $m = WWW::Mechanize->new( autocheck => 1 );

print "LWP: $LWP::UserAgent::VERSION\n";
print "Mech: $WWW::Mechanize::VERSION\n";
print "Net::SSLeay $Net::SSLeay::VERSION\n";

my $url = $ARGV[0];

$m->get($url);
print $m->content();
[download]

Which outputs;

$ ./testit.pl
LWP: 6.43
Mech: 1.96
Net::SSLeay 1.88
Error GETing https://xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx: Can't conn
+ect to xxxxxxxxxxx:443 (certificate verify failed) at ./testit.pl lin
+e 15.
$
[download]

I suspect there is something available on the companies servers that satisfies browsers but isn't available elsewhere. Anyone seen this before and have any idea what I need to do? Thanks

Comment on WWW::Mechanize and SSL Select or Download Code

Replies are listed 'Best First'.
Re: WWW::Mechanize and SSL by hippo (Bishop) on Aug 10, 2022 at 13:31 UTC
The first thing I would do is to check that your version of Mozilla::CA is up to date. After that simple test, try to diagnose the actual error. See my general advice about `debug4` in Re: How to get a better error message from LWP::UserAgent on missing SSL certificates?. Hopefully that will give you (and us) more to go on. 🦛	[reply] [d/l]
Re: WWW::Mechanize and SSL by Corion (Patriarch) on Aug 10, 2022 at 13:41 UTC
`certificate verify failed` This means that whatever website you're accessing is serving a SSL certificate that is not stored in the certificate store of Perl (see Mozilla::CA). The two approaches are to either install the appropriate SSL certificate (ask your administrator) and , or to force WWW::Mechanize (and LWP::UserAgent) Maybe the following works: `$ua = WWW::Mechanize->new( ssl_opts => { SSL_ca_path => '/etc/ssl/file-with-company-certificates' +, verify_hostname => 1, } );` [download] The other is to switch off the SSL host verification: `<p>Maybe the following works:</p> <c> $ua = WWW::Mechanize->new( ssl_opts => { verify_hostname => 0, } );` [download]	[reply] [d/l] [select]
Re: WWW::Mechanize and SSL by Jonathan (Curate) on Aug 11, 2022 at 12:43 UTC
Thanks guys, You've pointed me in the right direction and it's now working, the problem was that I had to install the companies local root certificate then run update-ca-certificates	[reply]


Syntactic Confectionery Delight
	PerlMonks