dennisgorelik: 2020-06-13 in my home office (0)
Dennis Gorelik ([personal profile] dennisgorelik) wrote in [personal profile] vak 2023-01-15 08:40 pm (UTC)

Re: C#

Oh.
[personal profile] vak meant "data representation in computer memory" (floating-point double vs decimal).
I thought he meant representation/conversion of data to decimal string.

In any case, the primary way to deal with imprecision is not increasing precision, but replacing number equality comparison with [epsilon] range comparison.

Post a comment in response:

This account has disabled anonymous posting.
If you don't have an account you can create one now.
HTML doesn't work in the subject.
More info about formatting

If you are unable to use this captcha for any reason, please contact us by email at support@dreamwidth.org