• chiliedogg@lemmy.world
    link
    fedilink
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    1 day ago

    But that 5/32 screw has its precision built into the measurement. Sig figs and error ranges aren’t required for fractional, because both are built into the denominator.

    If your 5/32 measurement is super precise you can record it as 160/1024ths, because the denominator has “+/- 1/2048” built into the measurement.

    • calcopiritus@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      12 hours ago

      As I said in another (larger) comment, you just don’t know how precision is encoded in decimals, which doesn’t mean that it isn’t. In fact, precision is encoded in decimals, just like with fractions.

      0,7 is 0,7 ± 0,05 0,7000 is 0,7 ± 0,00005

      • chiliedogg@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        4 hours ago

        I have a set of precision digital calipers that shows decimal or fractional units. Verus a worse set of calipers that’snot 10x worse, it shows exactly the same measurements in decimal units, but with fractional units it will show a difference because that difference can be represented.

        • calcopiritus@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          3 hours ago

          Is there anyone in this world needs a caliper of precision between 1cm and 1mm that can’t afford a 1mm of precision caliper?