Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re: Testing proxy "health"

by gamache (Friar)
on Oct 22, 2007 at 15:47 UTC ( [id://646473]=note: print w/replies, xml ) Need Help??


in reply to Testing proxy "health"

I once dealt with this problem by giving each proxy N chances to fail, and after one reached N failures, I'd remove it from the list. It was a pound of cure rather than an ounce of prevention, but it more or less did the job. This method was used in a program where I was hitting 60-100 proxies at a time, so having a few not working at any given moment wasn't of high importance as long as things settled out eventually.

Replies are listed 'Best First'.
Re: Testing proxy "health"
by hacker (Priest) on Oct 22, 2007 at 18:11 UTC

    Can you explain to me how you were able to "kill" the running process trying to reach a dead, down, unavailable proxy?

    I've tried this, and once I attempt to access content via a down proxy in my array, I have to sit and wait until that proxy times out, before I can try again.

    I'm not sure how to capture that "downed" state, kill the process attempting to use that proxy, and then loop across another proxy until I find one that works.

      What about just setting a shorter timeout?

      non-Perl: Andy Ford

        Bingo, this is what I did.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://646473]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (4)
As of 2024-04-21 14:38 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found