http://qs321.pair.com?node_id=761527

whakka has asked for the wisdom of the Perl Monks concerning the following question: (http and ftp clients)

I need to automate a script for crawling web pages, but these pages use Javascript/AJAX for form processing and the like. LWP and WWW::Mechanize don't handle this case well. What can I do?

Originally posted as a Categorized Question.