Just another Perl shrine | |
PerlMonks |
Re: sorting very large text filesby talexb (Chancellor) |
on Dec 21, 2009 at 18:58 UTC ( [id://813746]=note: print w/replies, xml ) | Need Help?? |
How about splitting the large file into smaller pieces, sorting the individual pieces, then merging those pieces into a single sorted file? The disadvantage is that you'd need at least double the original file size in free space, but you might mind that the total CPU time would be less, since merging would be fairly fast. There are lots of cool ways to do it:
Alex / talexb / Toronto Team website: Forex Chart Monkey, Forex Technical Analysis and Pickpocket Prevention "Groklaw is the open-source mentality applied to legal research" ~ Linus Torvalds
In Section
Seekers of Perl Wisdom
|
|