Re: Need Fast LWP GET

This is generally handled by using fork. But if you don't watch how many children you're creating, you will fork bomb your system. I've found Parallel::ForkManager is a really nice, unobstrusive layer above fork that provides pretty much what you're going to need. That said, there are a variety of async modules out there; but I am pretty sure they all fork under the hood since Perl doesn't support threads unless they've written some fancy pthreaded XS backends (which maybe some have).

Comment on Re: Need Fast LWP GET

Replies are listed 'Best First'.
Re^2: Need Fast LWP GET by bobinyec (Acolyte) on Jun 13, 2020 at 11:14 UTC
Thank you to all who responded. Manipulating STDOUT and STDERR with CLOSE/OPEN didn't work. I'm trying to do this on a commercial web hosting service so I don't have access to the more non-mainstream solutions mentioned. Fortunately, the target process of the LWP isn't intolerably long, so the situation is acceptable. jb	[reply]
Re^3: Need Fast LWP GET by tybalt89 (Monsignor) on Jun 13, 2020 at 12:35 UTC
I think you also have to close STDIN, perhaps depending on which web server is being used.	[reply]
Re^4: Need Fast LWP GET by bobinyec (Acolyte) on Jun 13, 2020 at 18:58 UTC
Bingo! Closing STDIN as well, worked! Thanks! jb	[reply]
Re^3: Need Fast LWP GET by haukex (Archbishop) on Jun 13, 2020 at 14:07 UTC
I'm trying to do this on a commercial web hosting service so I don't have access to the more non-mainstream solutions mentioned. Please see Yes, even you can use CPAN - if you have shell access to the machine, it's very likely you can install modules there, using something like local::lib, and sometimes it's possible even if you don't have shell access. Personally I'd prefer to help you with that rather than some other hacked solution :-)	[reply]
Re^3: Need Fast LWP GET by perlfan (Vicar) on Jun 13, 2020 at 17:23 UTC
There is perlbrew. Also a VM on digital ocean is $5/mo, which provides a nice companion to any share hosting account environment. Those are not suitable for the kind of shell home you want. Also check out SDF/freeshell.	[reply]


Problems? Is your data what you think it is?
	PerlMonks