[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Octave-bug-tracker] [bug #59266] 1-0.00000035 returns 1
|
From: |
Kai Torben Ohlhus |
|
Subject: |
[Octave-bug-tracker] [bug #59266] 1-0.00000035 returns 1 |
|
Date: |
Wed, 14 Oct 2020 05:38:18 -0400 (EDT) |
|
User-agent: |
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.75 Safari/537.36 |
Update of bug #59266 (project octave):
Severity: 3 - Normal => 2 - Minor
Status: None => Invalid
Open/Closed: Open => Closed
_______________________________________________________
Follow-up Comment #1:
Thank you for your report, but by default the output is rounded, see
https://www.octave.org/doc/v5.2.0/XREFformat.html for details.
>> format long
>> 1-0.00000035
ans = 9.999996500000000e-01
Also keep in mind, that Octave is a software for numerical computations. The
number are not infinitely precise
https://en.wikipedia.org/wiki/Round-off_error
_______________________________________________________
Reply to this item at:
<https://savannah.gnu.org/bugs/?59266>
_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/