Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic
 
PerlMonks  

Re: Re: Re: Re: Connection: Keep-Alive and Perl

by mattr (Curate)
on May 30, 2001 at 10:55 UTC ( [id://84185]=note: print w/replies, xml ) Need Help??


in reply to Re: Re: Re: Connection: Keep-Alive and Perl
in thread Connection: Keep-Alive and Perl

Thank you dfs and shotgunefx, two great ideas.

The big problem was browser timeout, which had not solved itself by just printing dots. I do dots a lot, maybe spaces that don't display would be good. For some reason I remember thinking the browser was timing out even with the dots being printed, but obviously the process must have just taken too long.

I had looked at IO::Tee (output to multiple handles) but I guess the answer is really just a fork as shotgunefx suggested. The Perl program directs the spidering and indexing of many websites into separate databases, so I would fork a child for each site, then have the child return a success code on finishing its work. I suppose this would even run more quickly with many children in parallel but I think I'll keep it serial for now to keep the log file readable.

Thanks. I guess I was a little *too* lazy a perl programmer.

  • Comment on Re: Re: Re: Re: Connection: Keep-Alive and Perl

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://84185]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others avoiding work at the Monastery: (None)
    As of 2024-04-25 03:54 GMT
    Sections?
    Information?
    Find Nodes?
    Leftovers?
      Voting Booth?

      No recent polls found