Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in precision

Double to string conversion different for .NET Framework and .NET Core

c# json.net double precision

Fortran array with explicit double precision

arrays fortran double precision dimension

How to remove the .0 when reading CSV with Pandas

pandas csv decimal precision

Differing Floating Point Calculation Results between x86_64 and ARMv8.2-A

floating-point fortran arm precision

Cassandra float precision

cassandra precision cassandra-3.0

Is there any numerical-accurracy difference on calculating sin(pi/2-A) and cos(A) in Matlab?

matlab precision trigonometry latitude-longitude numerical-methods

Is there any "standard" way to calculate the numerical gradient?

c++ math precision numerical-methods

Why does np.exp(1000) give an overflow warning but np.exp(-100000) not give an underflow warning?

python numpy precision

Precision of SVG coordinates?

browser svg coordinates precision specifications

Restoring the exact angle from std::cos(angle) using std::acos

c++ std precision numerical-stability

How do I use parameter epsabs in scipy.integrate.quad in Python?

python scipy precision numerical-integration quad

boost lexical cast double to string giving invalid results

c++ boost double precision boost-lexicalcast

Precise Multiplication without floating point arithmetic

python precision multiplication

How to convert a number to 12 bits precision in python?

python types floating-point precision floating-accuracy

Smallest i with 1/i == 1/(i+1)?

python floating-point precision ieee-754 floating-accuracy

Why does Rust only use 16 significant digits for f64 equality checks?

rust floating-point precision

C: Rounding floats

c floating-point precision

Is there a functional difference between "2.00" and "2.00f"?

c++ floating-point precision literals suffix

C++ output align and decimal place holder?

c++ precision

How to compute sign(a² - b * c) * sqrt(abs(a² - b * c)) accurately with floating point arithmetics?

floating-point precision numeric floating-accuracy
« Newer Entries Older Entries »