[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Interpretation of result
|
From: |
Rhys Ulerich |
|
Subject: |
Re: Interpretation of result |
|
Date: |
Mon, 17 Sep 2012 14:07:50 -0500 |
> Can anybody explain this to a simple mortal who did not take a
> rigorous numerical calculus class?
>
> octave:89> 99999999999999999 - 99999999999999998
> ans = 0
>
> (that is 17 digits) ...
>
> Thanks!!
Even if you never take a formal course, you should read over the
classic article "What every computer scientist should know about
floating-point arithmetic" by David Goldberg.
http://dl.acm.org/citation.cfm?id=103163
The article should answer your question and give you insight into a
whole host of issues related to it.
- Rhys