octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #61290] Unexpected rounding of min and max wit


From: anonymous
Subject: [Octave-bug-tracker] [bug #61290] Unexpected rounding of min and max with integer types
Date: Tue, 5 Oct 2021 12:31:47 -0400 (EDT)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:92.0) Gecko/20100101 Firefox/92.0

Follow-up Comment #1, bug #61290 (project octave):

Additional information. Please examine this inconsistency in return types:


>> min (uint8(250), uint32(1e7)), class(ans)
ans = 250
ans = uint32

>> min (uint8(250), sqrt(flintmax)), class(ans)
ans = 250
ans = uint8


    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?61290>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]