Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re: Slow but it works

by gbarr (Monk)
on Oct 03, 2001 at 17:53 UTC ( [id://116446]=note: print w/replies, xml ) Need Help??


in reply to Slow but it works

It is slow probably because you seem to be doing an awful lot of reading and writing. An example log entry would have helped, but the following (with the addition of the appropriate checking) will create the log file on sorted order without a temp file and without readin the whole file into memory.

my $MAXBUFLEN = 1024 * 1024; # 1M sub sort_logfile { my $file = shift; my @off = (0); my @lines; open(INFILE, "<$file"); while(<INFILE>) { push @off, tell; if (/^\d.*?\[([^\]]+)\]/) { push @lines, [$1, $.-1]; } else { # assume any non-matching line # is a continuation of the previous $off[-2] = $off[-1]; next; } } @lines = sort { $a->[0] cmp $b->[0] } @lines; open(INFILE,"<$file"); my $line = 0; my $buf; while (my $i = shift @lines) { my ($start, $end) = ($i->[1],$i->[1]+1); while( @lines and $lines[0]->[1] == $end) { shift @lines; $end++; } ($start,$end) = @off[$start,$end]; my $len = $end - $start; while ($len > 0) { seek(INFILE, $start, 0) or die "seek: $!"; read(INFILE, $buf='', $len > $MAXBUFLEN ? $MAXBUFLEN : $len) or die "read: $!"; print $buf; $len -= length $buf; } } }

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://116446]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others exploiting the Monastery: (3)
As of 2024-04-19 20:04 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found