Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: 4k read buffer is too small

by starbolin (Hermit)
on Jun 16, 2008 at 20:30 UTC ( [id://692360]=note: print w/replies, xml ) Need Help??


in reply to 4k read buffer is too small

voeckler writes:

... I kindly disagree that 4k is enough for everybody.
I don't mean to be difficult but that's not what graff said. What he said was 4k a compromise that didn't adversely impact the implementation of perl for majority of users. I'm sure the 4k number is tied to the 'small' sbrk request size, so I'm think increasing beyond 4k is going to mean tweeking malloc. Perhaps also increasing the number of buffers used in parsing an input stream into line chunks.

Now for one of those dumb, it's-not-my-budget, questions: Why not buy ( or ask for) a bigger local disk? 8GB is small now days.


s//----->\t/;$~="JAPH";s//\r<$~~/;{s|~$~-|-~$~|||s |-$~~|$~~-|||s,<$~~,<~$~,,s,~$~>,$~~>,, $|=1,select$,,$,,$,,1e-1;print;redo}

Replies are listed 'Best First'.
Re^2: 4k read buffer is too small
by voeckler (Sexton) on Jun 17, 2008 at 03:29 UTC
    Concerning bying new disks: I was trying to make an example with numbers with the 8GB case, to show that it is already doing bad things to the NFS server. In actuality, the local disks on our machines permit 60 GB scratch each. However, some rule files are 123 GB (and 500 mio lines).

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://692360]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others rifling through the Monastery: (2)
As of 2024-04-20 04:19 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found