Beefy Boxes and Bandwidth Generously Provided by pair Networks
"be consistent"
 
PerlMonks  

•Re: Checking links with LWP::UserAgent

by merlyn (Sage)
on Feb 26, 2002 at 15:02 UTC ( [id://147589]=note: print w/replies, xml ) Need Help??


in reply to Checking links with LWP::UserAgent

You might want to look at the various solutions I've posted in my columns, specifically to parallelize the probing. Be cautious, however, that you don't overwhelm the server under test. {grin}

-- Randal L. Schwartz, Perl hacker

  • Comment on •Re: Checking links with LWP::UserAgent

Replies are listed 'Best First'.
Re: •Re: Checking links with LWP::UserAgent
by wilstephens (Acolyte) on Feb 27, 2002 at 12:05 UTC
    Thanks for the link & advice, Randal. I've got a database of around 200 URLs, say I checked 10 at a time using LWP::parallel it shouldn't hurt the server too much, shoult it?

    It's a preety high-spec dedicated machine. What would anyone say would be the limit to these parallel connections?

    --
    Wiliam Stephens <wil@stephens.org>

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://147589]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others wandering the Monastery: (7)
As of 2024-04-25 16:15 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found