Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in floating-point

IEEE-754 32 Bit (single precision) exponent -126 instead of -127

floating-point ieee-754

Get only the first 10 number of a X lenght digit

c# floating-point

The AVX intrinsic _mm256_rsqrt_ps has much greater relative error than it should have according to the intrinsics guide

c++ floating-point intrinsics avx

int and float in function overloading

c++ floating-point int overloading

Standard math functions reproducibility on different CPU's

c++ c floating-point precision

complex multiplication / divison with infinity and nan

math floating-point ieee-754 complex-numbers

Simple Math Error in gfortran?

floating-point fortran gfortran

Using C: How can I determine the sizes of the components of a floating point?

floating-point exponent mantissa

How to round float to the upper/lower representation

c++ floating-point floating-point-precision

Rails BigDecimal precision not helping with floats [duplicate]

ruby floating-point rounding bigdecimal floating-point-precision

After converting bits to Double, how to store actual float/double value without using BigDecimal?

java floating-point bigdecimal ieee-754 single-precision

Precision when converting int32 to other types

python numpy floating-point precision type-conversion

Why my precision getting loss while converting double to float in c#?

c# floating-point double precision

Unity 2017 vs Unity 5.x "float" differs

unity-game-engine floating-point

SQL Server 2008: Error converting data type nvarchar to float

sql-server-2008 casting floating-point nvarchar

How to refine floating-point division on FMA-capable GPUs?

math floating-point gpu division fma

why float-pointing numbers don't overflow to infinity

c floating-point
« Newer Entries Older Entries »