Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in floating-point

how to get numbers to have precision of .05?

actionscript-3 math actionscript floating-point rounding

Truncate float (not rounded) to 2 decimal places

javascript floating-point rounding

Is there a Perl module to convert c99 hex floating point notation to regular notation?

perl floating-point hex string-parsing

Big float for shader-based mandelbrot explorer

graphics floating-point floating-accuracy bignum mandelbrot

Float versus Integer arithmetic performance on modern chips

floating-point performance integer math

Understanding how these floating point numbers work?

floating-point theory

IEEE-754 32 Bit (single precision) exponent -126 instead of -127

floating-point ieee-754

Get only the first 10 number of a X lenght digit

c# floating-point

The AVX intrinsic _mm256_rsqrt_ps has much greater relative error than it should have according to the intrinsics guide

c++ floating-point intrinsics avx

int and float in function overloading

c++ floating-point int overloading

Standard math functions reproducibility on different CPU's

c++ c floating-point precision

complex multiplication / divison with infinity and nan

math floating-point ieee-754 complex-numbers

Simple Math Error in gfortran?

floating-point fortran gfortran

Using C: How can I determine the sizes of the components of a floating point?

floating-point exponent mantissa

How to round float to the upper/lower representation

c++ floating-point floating-point-precision

Rails BigDecimal precision not helping with floats [duplicate]

ruby floating-point rounding bigdecimal floating-point-precision
« Newer Entries Older Entries »