octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #41359] Output formatting inconsistency for in


From: Glenn Golden
Subject: [Octave-bug-tracker] [bug #41359] Output formatting inconsistency for integers > 2^52
Date: Mon, 27 Jan 2014 14:44:12 +0000
User-agent: Opera/9.80 (X11; Linux i686) Presto/2.12.388 Version/12.16

Follow-up Comment #2, bug #41359 (project octave):

Interesting, I see what you mean. Need an integer test that's independent of
the float EPS.

Fwiw -- perhaps nothing, just an observation -- printf %.16g does get it
right:

+verbose+
>   a = 2^52 + (-5:5);
>   printf("a: %.16gn", a)
a: 4503599627370491
a: 4503599627370492
a: 4503599627370493
a: 4503599627370494
a: 4503599627370495
a: 4503599627370496
a: 4503599627370497
a: 4503599627370498
a: 4503599627370499
a: 4503599627370500
a: 4503599627370501
-verbose-

So might be worth a look at how the integer test is being handled there. 

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?41359>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]