Such a system happens to be available in GNU make. You can control the number of commands executed in parallel with the -j option, so make -j4 would start at most 4 processes in parallel.

If you happen to have a good way to factor everything so that each step produces a file (and reads the files it depends on), this might be an elegant solution.