Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Re: How do I perform web automation with sites that use Javascript?

by ninuzzo (Novice)
on Mar 12, 2011 at 23:16 UTC ( [id://892876]=note: print w/replies, xml ) Need Help??


in reply to How do I perform web automation with sites that use Javascript?

A recent addition of mine is WWW::HtmlUnit::Spidey. This module uses the Java library HtmlUnit which is a headless browser with pretty good JavaScript support. Do not worry, you won't have to write any Java code :D

It is good for massive web scraping where screen scraping does not scale and may be unstable.

There is a tutorial here that scrapes some data obtained from a form not working without JavaScript support.

Btw I am just a Perl beginner. Any Perl guru interested in co-developing Spidey?

Replies are listed 'Best First'.
Re: Answer: How do I perform web automation with sites that use Javascript?
by Anonymous Monk on Mar 13, 2011 at 03:59 UTC
    If you wish to recruit, try perl news section, much more visible

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://892876]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others chanting in the Monastery: (4)
As of 2024-03-28 21:07 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found