Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in floating-point

Is FLT_RADIX ever not 2 in C11 for modern general purpose computers?

c floating-point c11

Can GDB correctly parse C-style hexadecimal floating-point numbers?

c floating-point gdb

How can I use NUnit's EqualTo().Within() constraint with a custom data type?

c# floating-point nunit assertions

Is IEEE 754-2008 deterministic?

javascript floating-point ieee-754 deterministic

Adding and subtracting exact values to float

java floating-point

Range of Float in Java

java floating-point precision

decimal.InvalidOperation error when rounding values in Series

python pandas floating-point decimal rounding

Why does python round(np.float16(np.pi),5) return infinity? Bug, limitation, or expected?

python numpy floating-point overflow rounding

How does Python compare 'int' to 'float' objects?

python python-3.x types floating-point comparison-operators

OpenGL: How do I avoid rounding errors when specifying UV co-ordinates

c opengl floating-point

Floating point limits

floating-point limits

Cosine in floating point

binary floating-point trigonometry

Are there float and double types with fixed sizes in C99?

c floating-point c99

How to compute a double precision float score from the first 8 bytes of a string in Python?

python sorting unicode floating-point double

Using depth buffer for layering 2D sprites

c++ opengl floating-point depth-buffer

Do floats, doubles, and long doubles have a guaranteed minimum precision?

c++ floating-point language-lawyer floating-point-precision minimum

How can I decode f16 to f32 using only the stable standard library?

floating-point rust precision

Why does Excel not round according to 8-byte IEEE 754

excel floating-point ieee-754

Compare a 32 bit float and a 32 bit integer without casting to double, when either value could be too large to fit the other type exactly

c++ floating-point arm precision

Comparing sqrt(n) with the rational p/q

performance math floating-point
« Newer Entries Older Entries »