Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in precision

Issues with checking the equality of two doubles in .NET -- what's wrong with this method?

Formatting numbers when writing to files in Mathematica

OpenCL Floating point precision

c++ windows opencl precision

Timestamp resolution

Float vs double Math Java

Why assignment of double to int does not trigger gcc warnings?

c gcc precision gcc-warning

How to calculate decimal digits of precision based on the number of bits?

Taking logs and adding versus multiplying

What is the numerical stability of std::pow() compared to iterated multiplication?

Apparently identical math expressions with different output

Find max integer size that a floating point type can handle without loss of precision

Adding floating point precision to qnorm/pnorm?

Extended double precision

double fortran precision

Multiplying floats and keep/get double precision accuracy

Is it better to perform n additions of a floating-point number or one integer multiplication?

Normalizing variables in C++ between (0,1) to gain accuracy in arithmetic

A example in Gotw 67

Floating Point Arithmetic error

Does a floating-point reciprocal always round-trip?

How does -march native affect floating point accuracy?