Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in floating-point

decimal.InvalidOperation error when rounding values in Series

python pandas floating-point decimal rounding

Why does python round(np.float16(np.pi),5) return infinity? Bug, limitation, or expected?

python numpy floating-point overflow rounding

How does Python compare 'int' to 'float' objects?

python python-3.x types floating-point comparison-operators

OpenGL: How do I avoid rounding errors when specifying UV co-ordinates

c opengl floating-point

Floating point limits

floating-point limits

Cosine in floating point

binary floating-point trigonometry

Are there float and double types with fixed sizes in C99?

c floating-point c99

How to compute a double precision float score from the first 8 bytes of a string in Python?

python sorting unicode floating-point double

Using depth buffer for layering 2D sprites

c++ opengl floating-point depth-buffer

Do floats, doubles, and long doubles have a guaranteed minimum precision?

c++ floating-point language-lawyer floating-point-precision minimum

How can I decode f16 to f32 using only the stable standard library?

floating-point rust precision

Why does Excel not round according to 8-byte IEEE 754

excel floating-point ieee-754

Compare a 32 bit float and a 32 bit integer without casting to double, when either value could be too large to fit the other type exactly

c++ floating-point arm precision

Comparing sqrt(n) with the rational p/q

performance math floating-point

C float literal translation

c gcc floating-point c89

What is going on with floating point precision here?

r floating-point matrix-multiplication stochastic stochastic-process

Is floating point expression contraction allowed in C++?

c++ floating-point fma

PHP floating point precision: Is var_dump secretly rounding and how can I debug precisley then?

php casting floating-point precision

Check if a number is exactly representable as `f32`

rust floating-point ieee-754

How to avoid floating point exceptions in unused SIMD lanes

floating-point clang simd floating-point-exceptions sigfpe
« Newer Entries Older Entries »