Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re: LWP question

by eric256 (Parson)
on Jan 20, 2010 at 22:47 UTC ( #818580=note: print w/replies, xml ) Need Help??


in reply to LWP question

I know in the past i've had issues with several of the search engines where they will block requests by IP if they see repeated requests by UserAgents that look like bots/spiders/etc. (Oh and please read that whole section below your post about formatting.


___________
Eric Hodges

Replies are listed 'Best First'.
Re^2: LWP question
by sri1230 (Novice) on Jan 21, 2010 at 14:45 UTC
    Thanks a bunch guys. It was a proxy issue, as i was using my work machine which was blocking it.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://818580]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (2)
As of 2023-03-31 03:13 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Which type of climate do you prefer to live in?






    Results (74 votes). Check out past polls.

    Notices?