http://qs321.pair.com?node_id=864562


in reply to Re^4: getting LWP and HTML::TokeParser to run
in thread getting started with LWP and HTML::TokeParser

Really, IIRC this looks as though only user agents 'EmailCollector' and 'GagaRobot' are dissalowed. All other user agents are dissalowed from seeing '*ROOT=1161830$' and '*/serverlet/PB/-s/*', but as specified under their '# Allow anything' comment.

Update: In my previous post I was really warning against documented terms of use, as I say I can't read German so am unable to tell if the site has any.

  • Comment on Re^5: getting LWP and HTML::TokeParser to run