|
|
|
| more useful options | |
| PerlMonks |
Re^5: getting LWP and HTML::TokeParser to runby marto (Cardinal) |
| on Oct 11, 2010 at 08:15 UTC ( [id://864562]=note: print w/replies, xml ) | Need Help?? |
|
Really, IIRC this looks as though only user agents 'EmailCollector' and 'GagaRobot' are dissalowed. All other user agents are dissalowed from seeing '*ROOT=1161830$' and '*/serverlet/PB/-s/*', but as specified under their '# Allow anything' comment. Update: In my previous post I was really warning against documented terms of use, as I say I can't read German so am unable to tell if the site has any.
In Section
Seekers of Perl Wisdom
|
|
||||||||||||||||||||||