|
| From: | Michael Leitner |
| Subject: | [Octave-bug-tracker] [bug #53166] format long displays 15 significant digits, rather than 15 digits after decimal point (Matlab Compatibility) |
| Date: | Fri, 16 Feb 2018 04:49:42 -0500 (EST) |
| User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0 |
Follow-up Comment #4, bug #53166 (project octave):
I'm sorry, probably I just let myself be bitten by this floating-point
business. Probably 0.9 has a floating-point representation that it just a bit
larger than 0.9 and thus gives rises to this seemingly incorrect rounding. But
the rest of my comment of course stands.
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?53166>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/
| [Prev in Thread] | Current Thread | [Next in Thread] |