|
From: | Markus Mützel |
Subject: | [Octave-bug-tracker] [bug #63848] Mean: single class inputs can overflow with sum producing wrong mean |
Date: | Wed, 1 Mar 2023 02:44:50 -0500 (EST) |
Follow-up Comment #7, bug #63848 (project octave): Is this really an overflow issue with `sum`? The expected approximate result of the summation (80e6*0.5) is still far from `realmax('single')` (approx. 3.4e38). I'd guess it is an issue caused by the limited precision of floating point numbers... _______________________________________________________ Reply to this item at: <https://savannah.gnu.org/bugs/?63848> _______________________________________________ Message sent via Savannah https://savannah.gnu.org/
[Prev in Thread] | Current Thread | [Next in Thread] |