Beefy Boxes and Bandwidth Generously Provided by pair Networks
good chemistry is complicated,
and a little bit messy -LW
 
PerlMonks  

Re: Task orchestrator or distributed state machine

by salva (Canon)
on Jul 09, 2014 at 13:37 UTC ( [id://1092906]=note: print w/replies, xml ) Need Help??


in reply to Task orchestrator or distributed state machine

From the high level, Net::OpenSSH::Parallel does mostly what you are asking for.

The issues you may find, besides being SSH based, is that it does not allows distributing a set of N works over a set of M workers. The relation is always N:N.

In other words, you can say, run this task, then this, then this on every host from this set, then join, then run this, etc.

But you can not say, spread this set of tasks over this set of hosts, then join, then ...

  • Comment on Re: Task orchestrator or distributed state machine

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1092906]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others browsing the Monastery: (5)
As of 2024-04-25 14:08 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found