That site explicitly excludes what you are trying to do in their Terms and Conditions.
True laziness is hard work
| [reply] |
Furthermore, that company is a Perl shop, and has even hosted Los Angeles Perl Mongers on occasion. If there's anything legitimate you would like to do involving them, get in touch with them and work it out together.
| [reply] |
Ignoring arguing about gun control in a thread where the poster wants to know how to load bullets. Let me continue with civil monastery behavior instead of berating. To decompress a HTTP body of gzip content, I suggest you to try
$zlib = new Compress::Raw::Zlib::Inflate( -WindowBits => WANT_GZIP, -C
+onsumeInput => 1 );
#LATER
sub onData {
my ($comp_in, $output, $status) = $_[0];
$status = $zlib->inflateReset() if $zlib->status() == Z_STREAM_EN
+D;
die "failed" if $status != Z_OK;
$status = $zlib->inflate($comp_in, $output);
die "failed" if $status != Z_OK && $status != Z_STREAM_END ;
print $output;
}
Of interest to you, may I suggest using Accept-Encoding, to disable gzip encoding on the HTTP compliant server? Although I must advise, for a bot, as you are writing, it is a poor use of your broadband connection, to transfer uncompressed data over it. It shall reduce the throughput and increase latency of your bot. I also suggest for you to research HEAD verb, to further reduce your bot's burden on the server and make greater economical use of your link and your processor. | [reply] [d/l] |