Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Re: Shared DBI handle supporting threads and processes

by Anonymous Monk
on Apr 20, 2020 at 23:07 UTC ( #11115850=note: print w/replies, xml ) Need Help??


in reply to Shared DBI handle supporting threads and processes

But any logic that expects "compute" cores to have to do I/O whether database or otherwise is quickly going to find all those "parallel" engines ... serialized. Working one-at-a-time or nearly so in a work flow that can actually be considerably slower than having ... one process. You will need to design more infrastructure here than either MCE or MCE::Shared is by itself really intended to provide, to feed the now-truly-compute cluster with data without delaying them, and also disposing of the computed data also without delay. While your example is interesting, it simply would not scale.
  • Comment on Re: Shared DBI handle supporting threads and processes

Replies are listed 'Best First'.
Re^2: Shared DBI handle supporting threads and processes
by erix (Parson) on Apr 21, 2020 at 09:43 UTC

    I think you're right, in a typical database situation.

    But one could imagine a case where the database is small enough to fit in memory. If that is combined with a read-mostly database, the above could be a good fit.

    I wish I had the time and the hardware to make a good benchmarked comparison, but alas.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://11115850]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (2)
As of 2020-09-26 13:54 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    If at first I donít succeed, I Ö










    Results (141 votes). Check out past polls.

    Notices?