Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re: Job scheduling?

by KurtSchwind (Chaplain)
on Jul 09, 2015 at 19:40 UTC ( [id://1134017]=note: print w/replies, xml ) Need Help??


in reply to Job scheduling?

Did you have a current copy of run_etl_jobs.pl for us to look at? Or are you asking that someone write it up from scratch for you?

--
“For the Present is the point at which time touches eternity.” - CS Lewis

Replies are listed 'Best First'.
Re^2: Job scheduling?
by laknarc (Initiate) on Jul 09, 2015 at 23:50 UTC

    i have this Perl script "run_etl_jobs.pl". when i start a batch by updating the batch status field in a table to "START", the script should run until i stop the batch. Also, within the loop, i need to get the job names with parameters returned by stored procedure and execute the jobs parallely . once these jobs are triggered, need to update the job status to "RUNNING" and log the start time to JOB_LOG table. once the jobs are completed, update the job status to "SUCCESS" and log the end time. Also, when 5 jobs are running and i should not run any other jobs(max we can run 5 jobs at a time). i have handled this in store proc. However, My question is that i need a startup script to build this master script with this scenarios. or else if CPAN have any built in modules/packages to schedule these kind of jobs with database repository. please point that. basically i'm building a scheduler so that i can use for my project.

      I think none of what you are trying to do is difficult... I do it quite a lot with my own etl projects... I like the idea of building configuration files for etl or any scraping work to help easily control everything... you can use anything to create configuration files... I like excel a lot, but mostly use perl because it's a habit for me now

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1134017]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others rifling through the Monastery: (5)
As of 2024-04-24 10:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found