Comment

Comment by nzentzis

The problem is that there aren’t enough digits of precision to represent the answer. The exact answer would be 999999.0000001, but let’s say you only have space to store six significant digits. The exact answer is way more precise, so you need to round it to the nearest representable value, 999999.

Floating-point rounding issues are the same thing but with binary digits instead of decimal ones.

parent nzentzis 2 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton