Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling
 
PerlMonks  

Re^3: How do I measure my bottle ?

by RazorbladeBidet (Friar)
on Mar 25, 2005 at 13:50 UTC ( [id://442333]=note: print w/replies, xml ) Need Help??


in reply to Re^2: How do I measure my bottle ?
in thread How do I measure my bottle ?

Then your hash insert is only taking 5 seconds (all other things being equal).

There is the memory consideration, also (as stated below).

Is this 20M records totalling 1GB or 1 TeraByte? (You mention 1,000 GB in your original post).

Is there a reason you are using a hash? (in your example it looks like you could use an array, but I understand it is merely a "test")

If you have many files (and it sounds like you do) - you could slurp in the entire file (one file at a time) and do the inserts, which will increase your memory usage but decrease CPU time. See File::Slurp
--------------
"But what of all those sweet words you spoke in private?"
"Oh that's just what we call pillow talk, baby, that's all."

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://442333]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others admiring the Monastery: (3)
As of 2024-04-26 07:08 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found