comment on

It's working! I used choroba's advice and removed the whole if...else construct. Resultant loop looks like this:

while (my $row= $csv->getline_hr($fh))
{
        $linecounter++;
        my $ip=$row->{'Source address'};
        my $url=$row->{'URL/Filename'};

        push @{ $ipURL{$ip} }, $url;

        if (!($linecounter % 50000))
        {
                print "Lines: $linecounter\n";
        }
}
        formatOutput(\%ipURL);
#       print Dumper \%ipURL;
[download]

The entire thing runs in about 45 seconds now:

perl test-urlListbyIP.pl
Lines: 50000
Lines: 100000
Lines: 150000
Lines: 200000
Lines: 250000
Lines: 300000
Lines: 350000
Lines: 400000
Lines: 450000
Lines: 500000
Lines: 550000
Lines: 600000
Lines: 650000
Lines: 700000
Lines: 750000
Lines: 800000
Lines: 850000
Formatting Output...
List End:1316
Execution Time: 44.18 s
[download]

In reply to Re: Hash Search is VERY slow by rtjensen
in thread Hash Search is VERY slow by rtjensen

Are you posting in the right place? Check out Where do I post X? to know for sure.
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
Want more info? How to link or How to display code and escape characters are good places to start.


Syntactic Confectionery Delight
	PerlMonks