• 0 Posts
  • 5 Comments
Joined 3 years ago
cake
Cake day: September 2nd, 2023

help-circle


  • That is not a flaw of decimals. It is a flaw of you not knowing how precision is encoded in decimals.

    0,7583 means 0,7583 ± 0,00005.

    0,758300 means 0,75833 ± 0,0000005.

    0,76 means 0,76 ± 0,005.

    That is why when in a store an item costs 7,5€, we don’t say 7,5€. We say 7,50€. Because it is precise to a hundredth of a €, not a tenth of a €.



  • Precision has nothing to do with the unit system. Or notation of fractions.

    0,001m is as precise as 1mm

    1/1000m is as precise as 1mm

    In SI you don’t even have prefixes, you use scientific notation with base units. You don’t say neither 1mm nor 0,001m. You say 1x10-3. Which is exactly the same as the other magnitudes of this comment.

    If you want precision in imperial, you could as easily say 0,00000000001 inch. It would be as precise as 0,000000000255 mm, or whatever the conversion is.