Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

What is the precision of ASiCalc?

asicalc precision
0
Posted

What is the precision of ASiCalc?

0

ASiCalc performs all internal operations with a precision of 17 digits. Still only 15 significant digits are displayed to compensate for internal errors. The actual precision depends upon complexity of the expression being calculated. Not all the digits of the displayed result will be accurate. Each operation on any floating point unit introduces some error (due to rounding and some other factors). For complex operations this error can multiply resulting in reduced precision. Roughly you can assume the first 10 significant digits to be accurate, though not in all cases.

Related Questions

What is your question?

*Sadly, we had to bring back ads too. Hopefully more targeted.