anyevent http 404code

liuweichuan has asked for the wisdom of the Perl Monks concerning the following question:

why can not open this web page and return 404 code via anyevent::http. but LWP can get this page. then can open other web site page.

use AnyEvent::HTTP;
    use AnyEvent;
    my @urls = qw(
http://www.zol.com/detail/cell_phone/QiKU/26847001.html?spm=634.42184
);
    
    my $cv = AnyEvent->condvar;
    for my $url ( @urls ) {
        $cv->begin;
        http_get $url,  sub {
            my ($data, $headers) = @_;
            foreach my $k (keys %$headers){
                print $k," : ",$headers->{$k},"\n";
            }
            $cv->end;
        }
    }
    $cv->recv;
[download]

Comment on anyevent http 404code Download Code

Replies are listed 'Best First'.
Re: anyevent http 404code by Krambambuli (Curate) on Oct 19, 2016 at 10:28 UTC
The relevant info in the AnyEvent::HTTP documentation refers to request headers and reads --- You really should provide your own "User-Agent:" header value that is appropriate for your program - I wouldn't be surprised if the default AnyEvent string gets blocked by webservers sooner or later. --- The server blocks the AnyEvent request, but works ok if you indicate another valid User-Agent. Like `http_get $url, headers => { 'User-Agent' => 'curl/7.47.1' }, sub { [...]` [download]	[reply] [d/l]
Re^2: anyevent http 404code by Anonymous Monk on Oct 20, 2016 at 02:51 UTC
headers => { 'User-Agent' => 'curl/7.47.1' }, for your code has syntax error	[reply]
Re^2: anyevent http 404code by liuweichuan (Acolyte) on Oct 20, 2016 at 03:20 UTC
for other web "https", error:TLS support not available on this system. done. install net ssleay it's ok now	[reply]
Re^3: anyevent http 404code by liuweichuan (Acolyte) on Oct 20, 2016 at 05:28 UTC
it can run now. install net ssleay	[reply]

Back to Seekers of Perl Wisdom