bash has asked for the wisdom of the Perl Monks concerning the following question:
Hello all,
I am working on web-spider and trying to find best solution for it.
I don't want to use fork()'ed process for fast page-fetching, because it takes extra over-head for inter-process communication. I want to do everything inside one process. I have tried LWP::Parallel, but looks like it can not give me really big speed (i still see that there are free CPU and Network resources).
Can you give me some good ideas how can i achieve my targets (one process, maximum network performance)?
|