Think about Loose Coupling | |
PerlMonks |
Re^3: How do I measure my bottle ?by RazorbladeBidet (Friar) |
on Mar 25, 2005 at 13:50 UTC ( [id://442333]=note: print w/replies, xml ) | Need Help?? |
Then your hash insert is only taking 5 seconds (all other things being equal). There is the memory consideration, also (as stated below). Is this 20M records totalling 1GB or 1 TeraByte? (You mention 1,000 GB in your original post). Is there a reason you are using a hash? (in your example it looks like you could use an array, but I understand it is merely a "test") If you have many files (and it sounds like you do) - you could slurp in the entire file (one file at a time) and do the inserts, which will increase your memory usage but decrease CPU time. See File::Slurp
-------------- "But what of all those sweet words you spoke in private?" "Oh that's just what we call pillow talk, baby, that's all."
In Section
Seekers of Perl Wisdom
|
|