Hello All, Here is the problem, I want to open a big giant file, and read all lines that have the text fwa into an array, then take that array and find out how many duplicates are in it, listing the duplicates and their count. Pretty simple, but then again...

#!/usr/bin/perl

system("clear");
open(FILE,"/var/log/everything");
my $i=0;
while($input=<FILE>){
     if($input=~/fwa/i){
     $i++; @parsed[$i]=$input;
     }
}
print "\n $i  entities";

foreach my $test (@parsed){
        my $data="";
        my $x="";
        my $t="";
                foreach my $final (@parsed){
                     if($final eq $test){
                     $x++;
                     my $data='valid_time';
                     }
                $t++;
                }
        if($data eq "valid_time"){
        print "$x $test";
        }
}
[download]

So you can see, I load the file, and then go through 2 foreach loops, the first gets the line, the 2nd compares the line to each of the other lines, and then returns true if it is found again, and outputs the count. This does not work at all, and the ram usage is 23MB, not good. Anyone think of a better way? Is there a simple array function to do this? Can I sort the array somehow first? Thanks in advance.

---

---

• Are you posting in the right place? Check out Where do I post X? to know for sure.
• Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:

  <code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>

• Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
• Want more info? How to link or How to display code and escape characters are good places to start.