Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re^2: WWW::Mechanize fetch differs from firefox browser result (was Re: WWW::Mechanize or WWW::Selenium with javascript redirect)

by perrin (Chancellor)
on Jan 18, 2007 at 22:19 UTC ( [id://595360]=note: print w/replies, xml ) Need Help??


in reply to Re: WWW::Mechanize fetch differs from firefox browser result (was Re: WWW::Mechanize or WWW::Selenium with javascript redirect)
in thread WWW::Mechanize or WWW::Selenium with javascript redirect

Seriously, there is no need to use Selenium or IE. If you use a logging proxy or the Firefox LiveHTTPHeaders extension, you will see exactly what the browser sends to the server, and then you just have to make your script send the same thing. No actual execution of JavaScript is required, since the server has no way to tell if you ran any client-side code or not.
  • Comment on Re^2: WWW::Mechanize fetch differs from firefox browser result (was Re: WWW::Mechanize or WWW::Selenium with javascript redirect)

Replies are listed 'Best First'.
Re^3: WWW::Mechanize fetch differs from firefox browser result (was Re: WWW::Mechanize or WWW::Selenium with javascript redirect)
by tphyahoo (Vicar) on Jan 19, 2007 at 09:38 UTC
    I am going to try out LiveHTTPHeaders; thanks for that suggestion. I think partly my difficulties are just due to my general ignorance of javascript.

    However, I still see value value in figuring out a more general way to do it, that susses out any popup windows and checks them, regardless of how they were generated. If I can get that to work, I won't have to change the code even if something changes in the javascript.

      I'm also trying LiveHTTPHeaders, the output is a little confusing though.

      Question:

      1. Many HTTP lines are passed.
      2. Do I need to create a new mech object for each "HTTP" that I captured?
      Has anyone had any success yet?
        So you need to read a basic HTTP/CGI tutorial

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://595360]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others romping around the Monastery: (2)
As of 2024-04-25 19:28 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found