i have this Perl script "run_etl_jobs.pl". when i start a batch by updating the batch status field in a table to "START", the script should run until i stop the batch. Also, within the loop, i need to get the job names with parameters returned by stored procedure and execute the jobs parallely . once these jobs are triggered, need to update the job status to "RUNNING" and log the start time to JOB_LOG table. once the jobs are completed, update the job status to "SUCCESS" and log the end time. Also, when 5 jobs are running and i should not run any other jobs(max we can run 5 jobs at a time). i have handled this in store proc. However, My question is that i need a startup script to build this master script with this scenarios.
or else if CPAN have any built in modules/packages to schedule these kind of jobs with database repository. please point that. basically i'm building a scheduler so that i can use for my project.
| [reply] |
I think none of what you are trying to do is difficult... I do it quite a lot with my own etl projects... I like the idea of building configuration files for etl or any scraping work to help easily control everything... you can use anything to create configuration files... I like excel a lot, but mostly use perl because it's a habit for me now
| [reply] |