Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in precision

Why assignment of double to int does not trigger gcc warnings?

c gcc precision gcc-warning

How to calculate decimal digits of precision based on the number of bits?

Taking logs and adding versus multiplying

What is the numerical stability of std::pow() compared to iterated multiplication?

Apparently identical math expressions with different output

Find max integer size that a floating point type can handle without loss of precision

Adding floating point precision to qnorm/pnorm?

Extended double precision

double fortran precision

Multiplying floats and keep/get double precision accuracy

Is it better to perform n additions of a floating-point number or one integer multiplication?

Normalizing variables in C++ between (0,1) to gain accuracy in arithmetic

A example in Gotw 67

Floating Point Arithmetic error

Does a floating-point reciprocal always round-trip?

How does -march native affect floating point accuracy?

AS3 x and y property precision

Python float precision float

higher precision floating point using boost lib (higher then 16 digits)

Using '/' with long double?

c double precision

x86-64 long double precision