Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in floating-accuracy

numpy.allclose() compare arrays with floating points

Function which returns coefficients of Legendre Polynomials not accurate enough

printing numbers with consistent or fixed accuracy

Accurate computation of PDF of standard normal distribution using C standard math library

Ray-plane intersection: inaccurate results - rounding errors?

Error in Floating point operation in C

whats the biggest number that is smaller than FLT_EPSILON?

Workaround for 'sum pk not equal to 1' error in scipy's stats.rv_discrete module

Why do I get a complex number using acos?

Exponents in C#

Calculating the angle between two vectors using a needle-like triangle

is log1p the "correct" way of doing log scale transformation of charts?

sprintf(buf, "%.20g", x) // how large should buf be?

python rounding error when sampling variable Y as a function of X with histogram?

Alternative to C++11's std::nextafter and std::nexttoward for C++03?

erroneous Visual C float / double conversion?

Big float for shader-based mandelbrot explorer