No such thing as a small change | |
PerlMonks |
Speeding things upby AlwaysSurprised (Novice) |
on Apr 14, 2018 at 23:42 UTC ( [id://1212899]=perlquestion: print w/replies, xml ) | Need Help?? |
AlwaysSurprised has asked for the wisdom of the Perl Monks concerning the following question: "I'll give you 10000 contiguous pages from Argos. You tell me the sum of the products" was the jist of the conversation. Ok honoured Monks. I confess I haven't programmed in perl since the last century and things have moved one. Quills are no longer needed in my editor of choice. So my thinking has been
to snort the response code, if it's a 200, then my $website_content = get($targetURL);and regex the info out of the page I'm after and add it to a file. Did it, but it's taking about a minute to process 100 pages. Oh wise ones, point out the errors in my thinking. I'm on a fast connection. Is that the bottle neck? Can I get it going significantly faster?
Back to
Seekers of Perl Wisdom
|
|