A Community Devoted to the Preservation and Practice of Celestial Navigation and Other Methods of Traditional Wayfinding
From: Tony Oz
Date: 2018 Dec 8, 23:27 -0800
Thank you for the reply.
In the corner of my mind I have a feeling that giving as precise values as cells allow is a Good Thing™. In the other corner there is a doubt - what digits should I consider for a rounded-off operand used with the 4-orders more precise one? Should I stuff zeroes there or should it be fives? Why? There is no information beyond the rounding border, it's lost. Is it meaningful to, say, divide a number where we are certain in eight places by a number where we are certain in only four?
Or is your suggestion valid in the formula at hands: hv(ZD)=n+(1-(n+m))·a ? With how many places should I carry the calculations then, to all eight?
The question remains - what should I do to the 0.9998-like values? To leave them as they are or to try to recover some precision there too? How then?