Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Having problems getting a single page

by ww (Archbishop)
on Feb 04, 2017 at 16:26 UTC ( #1181097=note: print w/replies, xml ) Need Help??


in reply to Having problems getting a single page

One wise step often: take a look at the header -- a fragment from your target follows:

<iframe src="javascript:false" title="" style="width: 0px; height: 0px +; border: 0px none; display: none;"></iframe> <script type="text/javascript" async="" src="//cdn.optimizely.com/js/2 +04774041.js"></script> ....

But, as it turns out, there are several threads here about similar problems, of which, this is one: Request by LWP Useragent refused by the web server but not by others.

That was found with Super Search -- a feature here that you'll often find helpful if you're careful about picking your search_terms.

Replies are listed 'Best First'.
Re^2: Having problems getting a single page
by Anonymous Monk on Feb 04, 2017 at 17:15 UTC
    Hi, Thank you for your help, I will try to look into this.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1181097]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (4)
As of 2020-09-27 04:03 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    If at first I donít succeed, I Ö










    Results (142 votes). Check out past polls.

    Notices?