Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Reduce CPU utilization time in reading file using perl

by talexb (Chancellor)
on Sep 27, 2013 at 17:11 UTC ( [id://1056028] : note . print w/replies, xml ) Need Help??


in reply to Reduce CPU utilization time in reading file using perl

I'd say your best bet is to process the file one line at a time, as has already been suggested, and put the relevant information into a database. Once it's there, you can gather and extract the information you need -- and let the database engine worry about figuring out the best way to store it all.

Alex / talexb / Toronto

Thanks PJ. We owe you so much. Groklaw -- RIP -- 2003 to 2013.

  • Comment on Re: Reduce CPU utilization time in reading file using perl