|go ahead... be a heretic
Re^4: Script exponentially slower as number of files to process increasesby xnous (Sexton)
|on Jan 28, 2023 at 11:28 UTC
First of all, thank you for your explanations and the work you put in suggesting an alternative.
Is running more workers than the number of logical CPU cores improving performance? There are golden CPU samples out there.
I don't know what to say, other than try to benignly bypass the perlmonks' filter and show somehow the graphs (if a janitor would be kind enough to URLify these, thanks). It does seem that in certain scenarios the first part of your statement holds true.
You need to copy/paste the links by hand, but it's worth the trouble.
EDIT: But of course it is, it's due to workers exiting early.
I also tested your updated script but it showed no tangible improvement on my setup.