NavList:
A Community Devoted to the Preservation and Practice of Celestial Navigation and Other Methods of Traditional Wayfinding
Re: Calculators, cosines, and floating point computation
From: Brad Morris
Date: 2019 Jun 3, 12:23 -0400
From: Brad Morris
Date: 2019 Jun 3, 12:23 -0400
Tony
Calculators do not use BCD (binary coded decimal). They use floating point representation which is an exponent and mantissa. How a floating point number is represented is getting pretty far from CN. Its only relevant if the resolution is insufficient. Which you have been gently told is not the case, except in extraordinary cases.
Brad
On Mon, Jun 3, 2019, 11:33 AM Tony Oz <NoReply_TonyOz@fer3.com> wrote:
Dear Frank,
You've said:
Apps can do that. :) You just toss in an extended precision library. But a real calculator? I don't think you'll find one!
The author of the "forensics" site mentions that he now meets modern no-name Chinese calculators that do 9°=9°, he thinks/speculates that those are in binary (rather than in more usual BCD) mode with 80-bits registers, which is equivalent to a 24-place precision.
Regards,
Tony60°N 30°E
