I used Randal Schwartz's forking parallel link checker as the base for a application that needed to run many children in parallel. It solves all your problems, even down to managing it so you can configure the number of child processes running at once.

It works really well and i have been happy with it! It cut the processing time in the application from 45 minutes to about 15!!