Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re: How can I find where I've been redirected to, in my scrapper?

by jcb (Parson)
on Jan 11, 2021 at 03:16 UTC ( [id://11126735]=note: print w/replies, xml ) Need Help??


in reply to How can I find where I've been redirected to, in my scrapper?

As you have found, the response object can report the final URL that was retrieved. If you actually need the redirect responses themselves, the previous and redirects methods on the final HTTP::Response object will give you the intermediate responses.

If you need to decide whether or not to follow the redirect, you can use the simple_request method instead of the request method on LWP::UserAgent.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11126735]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others sharing their wisdom with the Monastery: (5)
As of 2024-04-23 18:03 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found