LWP will by default follow redirects between 10-15 times before giving up. It is a configurable parameter. Some of the more intelligent sites will also ignore you if your UserAgent isn't something well known like Mozilla or IE. Change the default UA string to avoid discrimination. Finally, some more intelligent (or not) sites will check your referer to try and avoid deep linking or (again) scripted webcrawlers.

Lucky for us, all of these defenses can be overcome with LWP. Long live Perl! The swiss-army chainsaw!