NavList:
A Community Devoted to the Preservation and Practice of Celestial Navigation and Other Methods of Traditional Wayfinding
Re: Poor St. Hilaire
From: John Karl
Date: 2007 Oct 16, 09:40 -0700
From: John Karl
Date: 2007 Oct 16, 09:40 -0700
John Karl wrote: > If we use a $12 calculator > we get 10-digit accuracy. Peter Fog wrote: > No, we get 10-digit precision. Accuracy depends on other factors, external > to the calculator. Actually, I do mean accuracy. Here I'm talking about the accuracy of calculators compared to inspection tables. HO 229 states that its max error in computed altitude is 0.3', and for altitudes below 86 degrees, a max error of 0.3' in computed azimuth. I've always assumed that my 10-digit TI-30 has 10-digit accuracy, which checks out where I can check it easily, such as in Log[sqr(2PI)]. I assume the same for trig functions. Now the equations for altitude and azimuth use so few arithmetic operations that not more than one, or two, places could be lost. So I'm reasoning that the calculator altitudes and azimuths are accurate to eight or nine places. In any case, it's sufficiently more accurate than the claimed accuracy of inspection tables that the calculator results can be considered exact. JK: > To all criminals against GPS, PF: > Why criminals? Because those who only use GPS think it's a crime that we CN people don't -- something like crimes against humanity; or at least they think we're silly, maybe even stupid. John Karl --~--~---------~--~----~------------~-------~--~----~ To post to this group, send email to NavList@fer3.com To , send email to NavList-@fer3.com -~----------~----~----~----~------~----~------~--~---