Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical
 
PerlMonks  

Re: Web Spidering Ajax Sites

by Joost (Canon)
on Sep 15, 2007 at 00:13 UTC ( [id://639113]=note: print w/replies, xml ) Need Help??


in reply to Web Spidering Ajax Sites

Selenium works by running the html/code through a javascript enabled browser.

Your question seems to be: is it possible to emulate a javascript-enabled browser in 100% pure perl, then the answer is yes.

The catch is that no-one has written anything even close to doing that. Even given working HTTP/WWW and JavaScript libraries it's very far from trivial to cook up a working/scriptable DOM model that can be used from the JavaScript code and is compatible with most current websites, or even a small subset of most websites. And I've tried. :-)

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://639113]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others having a coffee break in the Monastery: (4)
As of 2024-03-29 05:27 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found