Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re: RFC. Distributed::Run module (idea & namespace)

by bm (Hermit)
on Sep 01, 2003 at 12:42 UTC ( [id://288122]=note: print w/replies, xml ) Need Help??


in reply to RFC. Distributed::Run module (idea & namespace)

Have you seen Parallel::Pvm ?
--
bm
  • Comment on Re: RFC. Distributed::Run module (idea & namespace)

Replies are listed 'Best First'.
Re: Re: RFC. Distributed::Run module (idea & namespace)
by zakzebrowski (Curate) on Sep 01, 2003 at 13:59 UTC
    Yeah. It looked a little hard to use. If you have had experience with it, I have a few questions:
    • OS dependencies? Can it run on multiple oses (including windows)?
    • Looks like you might need to have it in mind while you are programming your program, not trying to add parallelism after the fact... is this true?
    • What if your main executable updates reguarly? Will it scp the files around for you to accomodate the change?
    • The user guide & manuall are at a 404 address. Is it actively supported?


    ----
    Zak
      I do not have any experience with the Perl interface, but do use pvm, specifically pvmgmake. It cut our build times down by 500%.
      One of its aims is to be hetrogenous, so yes it runs on the major OS's (including windows).
      Your question about the main executable is a good one. I have no idea. One would think so...
      I agree that it looks like you need to design your application with pvm in mind, but this looks to be unavoidable. I cannot conceive of a general way to add parallelism after the fact: how the spawned processes synchronisation be completely general?
      I would be surprised if pvm is not still active (their website is still updated):
      http://www.csm.ornl.gov/pvm/pvm_home.html
      http://www.netlib.org/pvm3/
      Not sure about the Perl interface.
      --
      bm
        Thanks for all of your points. I'm thinking about this now...
        Re: pvm in mind... well, the synchronization aspects that I've had to done so far have been trivial. For instance, all I've done is 'close enough' synchronization. If I'm stress testing a network connection that is going to take an hour to run, taking 3 seconds to synchronize, that may be ok. For synchronizing per host, an ini file per run will allow for multiple processing with individual arguments... (The last statement was hard. If you have two hosts and you want one host to have one argument and another host to have another argument, a paramaters file which allows you to specify what host get what argument is an attempt to do this...)
        Btw, the link in the perldoc for pvm was broken... i notified the autor...

        ----
        Zak

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://288122]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others cooling their heels in the Monastery: (None)
    As of 2024-04-19 00:10 GMT
    Sections?
    Information?
    Find Nodes?
    Leftovers?
      Voting Booth?

      No recent polls found