Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re: Shared DBI handle supporting threads and processes

by Anonymous Monk
on Apr 23, 2020 at 18:31 UTC ( #11115967=note: print w/replies, xml ) Need Help??


in reply to Shared DBI handle supporting threads and processes

Your real problem here is that you are asking compute nodes to do database I/O. Which utterly and completely defeats the purpose.

If you have "400 compute blades" and "398 of them are waiting for I/O" you have accomplished zero. Parallel compute-servers must be handed all of the data that they require such that they do not need to "wait" for anything. Ever. Unless all of them are straining the heat-dissipating capacity of your hardware to its utmost, they are not doing their job.

In your present design, the "ruling constraint" is the capacity of the database server, which completely frustrates nearly all of your parallel silicon.

  • Comment on Re: Shared DBI handle supporting threads and processes

Replies are listed 'Best First'.
Re^2: Shared DBI handle supporting threads and processes
by 1nickt (Abbot) on Apr 24, 2020 at 02:35 UTC

    Oh shut up, Mike. Maybe in your prehistoric world databases can only handle two connections, but the rest of us have moved on.


    The way forward always starts with a minimal test.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://11115967]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (4)
As of 2020-09-19 03:56 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    If at first I donít succeed, I Ö










    Results (114 votes). Check out past polls.

    Notices?