Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re^4: Loading Large files eats away Memory

by ivancho (Hermit)
on May 26, 2005 at 10:37 UTC ( [id://460606]=note: print w/replies, xml ) Need Help??


in reply to Re^3: Loading Large files eats away Memory
in thread Loading Large files eats away Memory

this doesn't work for me.. it takes up 56MB when we tie it, but then it seems the sequential access to 100_000 etc, eats memory along the way.. by the <STDIN> line my perl is on 95MB.. read and write seem to eat separately - if I'm evil and ask for $lines[-1] and then write to it, it gets up to 200MB - worse than splitting the slurp...
  • Comment on Re^4: Loading Large files eats away Memory

Replies are listed 'Best First'.
Re^5: Loading Large files eats away Memory
by BrowserUk (Patriarch) on May 27, 2005 at 07:03 UTC

    How long are the lines in your file?


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    Lingua non convalesco, consenesco et abolesco. -- Rule 1 has a caveat! -- Who broke the cabal?
    "Science is about questioning the status quo. Questioning authority".
    The "good enough" maybe good enough for the now, and perfection maybe unobtainable, but that should not preclude us from striving for perfection, when time, circumstance or desire allow.
      variable.. 1,400,000 lines of 12 x's and the line number.. so maximum 19 chars..

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://460606]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others examining the Monastery: (6)
As of 2024-04-19 15:20 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found