go ahead... be a heretic | |
PerlMonks |
Re: Parse data into large number of output files.by Roger (Parson) |
on Sep 29, 2004 at 12:31 UTC ( [id://394944]=note: print w/replies, xml ) | Need Help?? |
I never had to worry about using up too much memory these days because my E2900 has 32Gb of RAM, so I would always build an enormous hash in memory. 100Mb doesn't sound like too much data at all, I would build a hash in memory with the sender id as the key, then the messages in the array:
Nowadays even a half decent machines should have plenty of memory. I'd say just read into memory and write out one user at a time.
In Section
Seekers of Perl Wisdom
|
|