# Exclude downloads from agents matching this regex, because they seem
+ to be
# related to mirroring or crawling rather than genuine downloads:

my $rx_agent_ignore = qr/
    \. google \.            |
    \. yahoo  \.            |
    \b LWP::Simple \b       |
    \b MS\ Search \b        |
    \b Webmin \b            |
    \b Wget \b              |
    \b teoma \b
/x;
[download]

Markus, I may be wrong, but I think that CPAN.pm uses LWP::Simple sometimes to download modules with, so excluding this would not be a good idea even though there is a good chance it could also be a spider.