|P is for Practical
Re^2: Counting concurrent event jobsby vagnerr (Prior)
|on Apr 24, 2006 at 18:11 UTC
Unfortunately that is not the case. The processing of these log files goes on for hours and involves hundreds of logs, each taking between a few minutes and an hour or two to run. We need to be able to graph the data (hence the csv output) and see that for example we do a lot of split jobs at one time of day and a lot of filter jobs at another. We need to know because some of the jobs use a lot of cpu, others may use a lot of network bandwidth, and we want to be able to tune things to share the resources we have.
Remember that amateurs built Noah's Ark. Professionals built the Titanic.