Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re: OT: How much float precision needed for operation?

by Enlil (Parson)
on Sep 02, 2005 at 19:11 UTC ( [id://488743]=note: print w/replies, xml ) Need Help??


in reply to OT: How much float precision needed for operation?

I think the term you are going to be looking for is, significant digits.

hth

-enlil

  • Comment on Re: OT: How much float precision needed for operation?

Replies are listed 'Best First'.
Re^2: OT: How much float precision needed for operation?
by 5mi11er (Deacon) on Sep 02, 2005 at 20:45 UTC
    Yes, indeed, significant digits is certainly one of the terms I need. I couldn't for the life of me remember that term, nor the closely related 'margin of error' when I first wrote my original post... Googling with "significant digits" hasn't yet led me to how to answer the question.

    I did find this link to a pdf discussing estimation of required significant digits, and I think it very likely applicable to my question, but the paper is far enough above my head that I'm unable to use that link without further assistance.

    -Scott

    Update: Ack, I hadn't seen trammell's post below when I posted this, I'm studying it now...

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://488743]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others admiring the Monastery: (7)
As of 2024-04-23 10:05 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found