|
From: | Liam Groener |
Subject: | Re: Some problems with numerical computation |
Date: | Mon, 23 Jan 2012 01:19:17 -0800 |
On Jan 22, 2012, at 10:16 PM, asha g wrote: This is a precision problem in your calculator calculation. Octave uses double precission in it's internal calculations. By default, output is rounded to 5 significant figures. To output to full precision, enter the command: format long Try repeating your calculator calculations using: a = 3.08333333333333 b = -8.96969696969697 c = 9.59090909090909 d1 = -4.60606060606061 ee = 0.901515151515151 Liam G. |
[Prev in Thread] | Current Thread | [Next in Thread] |