Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in precision

How to calculate decimal digits of precision based on the number of bits?

Taking logs and adding versus multiplying

What is the numerical stability of std::pow() compared to iterated multiplication?

Apparently identical math expressions with different output

Find max integer size that a floating point type can handle without loss of precision

Adding floating point precision to qnorm/pnorm?

Extended double precision

double fortran precision

Multiplying floats and keep/get double precision accuracy

Is it better to perform n additions of a floating-point number or one integer multiplication?

Normalizing variables in C++ between (0,1) to gain accuracy in arithmetic

A example in Gotw 67

Floating Point Arithmetic error

Does a floating-point reciprocal always round-trip?

How does -march native affect floating point accuracy?

AS3 x and y property precision

Python float precision float

higher precision floating point using boost lib (higher then 16 digits)

Using '/' with long double?

c double precision

x86-64 long double precision

How do I print double in Python with exact precision? [duplicate]

python double precision