Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re: When is a flat file DB not enough?

by petdance (Parson)
on Jul 03, 2001 at 21:26 UTC ( [id://93590]=note: print w/replies, xml ) Need Help??


in reply to When is a flat file DB not enough?

There is no number N where N turns performance unacceptable. It's a number that you'll have to derive yourself, based on parameters of acceptability that you have to try yourself.

It's misguided to try to find a magic number. What you'll have is a curve of performance, probably something like this

Records => response time
100 => effectively instant
1000 => 1 sec
10000 => 3 sec
100000 => 10 sec
1000000 => 5 minutes
Once you derive that curve, you can say "OK, if we want to keep performance around 10 second response time, we can't have more than 100000 records, and if we want more than that, we're going to have to go to a bigger/different system."

The other part of it is to define very carefully what that performance acceptability is. Is it OK if the user has to wait 1 second to do an update? 10 seconds? A minute? Define those, in writing, and make sure that you get that approved by anyone who could squawk. There's nothing worse than having your requirements changed out from under you, when your boss says "Hey, it's taking too long to update", because you thought that a 5-second lag was acceptable.

xoxo,
Andy
--
Throw down the gun and tiara and come out of the float!

Replies are listed 'Best First'.
Re: Re: When is a flat file DB not enough?
by TrinityInfinity (Scribe) on Jul 03, 2001 at 22:25 UTC
    That's the kind of situation I'll need to explain to the bosses. What will keep the number of records down though is the users tendency to whine if things aren't as close to instant as possible, but also my own insecurities about the database. While I've made it to tbe best of my abilities, I still fear that someone will update it and it'll explode and loose all data - you know, something silly
    Still, thanks for that mini-table of numbers. Managers love pictures =)

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://93590]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others meditating upon the Monastery: (4)
As of 2024-03-29 09:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found