Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid
 
PerlMonks  

Re: While loop with addition goes weird

by Anonymous Monk
on Apr 08, 2018 at 14:03 UTC ( #1212536=note: print w/replies, xml ) Need Help??


in reply to While loop with addition goes weird

As the articles that you've already been pointed to say, computers use a float-binary representation. The number 1/10 does not have an exact representation in base-2 floats, much as 1/3 does not have an exact representation in a base-10 float. Computers can handle this problem by using decimal (BCD = Binary-Coded Decimal) arithmetic, but Perl does not directly expose this type. One pragmatic solution to your problem might be to count using integers, where the integer is the desired number multiplied by 100. Then, each time, calculate the float by casting the integer to a float and dividing it by 100. Because this is done each time, errors do not accumulate. Many database systems employ a variation of this "scaled integer" strategy to handle their currency data type.
  • Comment on Re: While loop with addition goes weird

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1212536]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (3)
As of 2020-10-22 06:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My favourite web site is:












    Results (225 votes). Check out past polls.

    Notices?