Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re^3: Running Parallel Perl Script on Linux Cluster

by Anonymous Monk
on Apr 01, 2006 at 20:14 UTC ( [id://540675]=note: print w/replies, xml ) Need Help??


in reply to Re^2: Running Parallel Perl Script on Linux Cluster
in thread Running Parallel Perl Script on Linux Cluster

Hi, this is monkey_boy (not logged in, as im at home),
  • the "touch" is to create an empty dummy file, seperate from your results file.
    The reasoning is that your results files will be created at the start of the processing, so your master script cannot check for the existance as proof of completion.
  • The END block always get executed at just before a script terminates, so its as good a place as any to "touch" the file.
  • @done_list is left for you to code, its simple perl, you have a list of jobs somewhere, convert them with a regex into a list of "done" files.
  • In reply to shltn's question, his way is probably better, as you'll hopefully get an error on failure (but given my experience with sun grid engine this is not always the case ;))

Hope this is helpfull. monkey_boy
  • Comment on Re^3: Running Parallel Perl Script on Linux Cluster

Replies are listed 'Best First'.
Re^4: Running Parallel Perl Script on Linux Cluster
by monkfan (Curate) on Apr 02, 2006 at 07:07 UTC
    @done_list is left for you to code, its simple perl, you have a list of jobs somewhere, convert them with a regex into a list of "done" files.
    Hi monkey_boy,

    Just to double confirm, @done_list will contain list of dummy files created in END block right? Or is it a list of actual output files? Sorry I'm a bit slow here....

    Regards,
    Edward
      Just to double confirm, @done_list will contain list of dummy files created in END block right?
      Correct.
      monkey_boy

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://540675]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others browsing the Monastery: (2)
As of 2024-04-24 13:27 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found