[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [bug-gawk] gawk simple compare not working?
From: |
Aharon Robbins |
Subject: |
Re: [bug-gawk] gawk simple compare not working? |
Date: |
Thu, 02 Apr 2015 07:36:30 +0300 |
User-agent: |
Heirloom mailx 12.5 6/20/10 |
> Date: Wed, 1 Apr 2015 10:23:43 -0400
> From: "Andrew J. Schorr" <address@hidden>
> To: address@hidden
> Cc: address@hidden, address@hidden
> Subject: Re: [bug-gawk] gawk simple compare not working?
>
> Hi,
>
> On Wed, Apr 01, 2015 at 12:21:48AM -0600, address@hidden wrote:
> > If you use -M, you should probably specify a precision larger than
> > the default of 53 which is the same as for double precision hardware
> > floating point.
>
> Regarding this: for huge integer values (as in this example), is it
> necessary to set PREC to a larger value? My recollection, and some basic
> testing, seem to indicate that integers will never lose precision with
> -M. Am I confused?
I think you're right, but I'd have to look harder at the code to be sure.
And had the original data had a decimal point in it, it would make a
difference. :-)
Thanks,
Arnold