more useful options | |
PerlMonks |
www::mechanize to scrape randomly ordered data?by punch_card_don (Curate) |
on Sep 19, 2008 at 14:46 UTC ( [id://712532]=perlquestion: print w/replies, xml ) | Need Help?? |
punch_card_don has asked for the wisdom of the Perl Monks concerning the following question:
Malthusian Monks,
Personal project - I'm thinking about next year's football pool. It seems an obvious thing for the Perl programmer in the pool to create a script that scrapes weekly stats from the league website and puts them into a DB for compilation & comparison. No more manual stats collection. Never done this, personally. Some reading suggests that www::mechanize would be a good module for this task. BUT - I've noticed that on the web page I'd want to scrape, the stats columns randomly change order on subsequent views. Either the programmer was just lazy and used producing randomly ordered output, OR the admins are intentionally trying to frustrate scrapers. Anyway - my questions:
Thanks. Time flies like an arrow. Fruit flies like a banana.
Back to
Seekers of Perl Wisdom
|
|