Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Increasing the write buffer

by apl (Monsignor)
on Jun 21, 2008 at 13:22 UTC ( [id://693274]=note: print w/replies, xml ) Need Help??


in reply to Increasing the write buffer

Unless you need to write to each of the 30,000 files after each line of input, I'd have @array[30000][100], and push to each relevant array after input.

Once you have 100 records associated with an output file, I'd

  • open the file to append
  • write the 100 records
  • flush and close the file
  • recycle

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://693274]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others chilling in the Monastery: (5)
As of 2024-04-19 04:27 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found