in reply to Matching lines in 2+ GB logfiles.
On modern hardware 2GB+ isn't really very big. Have you tried just reading it line-by-line with <F>? I don't know what your performance requirements are but most log-parsing jobs aren't terribly performance sensitive.
You might find that you don't have to tune your regex much once you switch to reading line-by-line. That's because each line will be much smaller than 8K, so the penalty for backtracking on a .* will be consequently much smaller.
-sam
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^2: Matching lines in 2+ GB logfiles.
by dbmathis (Scribe) on May 01, 2008 at 17:08 UTC | |
by dave_the_m (Monsignor) on May 01, 2008 at 17:55 UTC | |
by samtregar (Abbot) on May 01, 2008 at 18:14 UTC | |
by bluto (Curate) on May 01, 2008 at 19:07 UTC | |
by mscharrer (Hermit) on May 01, 2008 at 18:16 UTC | |
by samtregar (Abbot) on May 01, 2008 at 18:24 UTC | |
by mscharrer (Hermit) on May 01, 2008 at 18:35 UTC |
In Section
Seekers of Perl Wisdom