Logo Questions Linux Laravel Mysql Ubuntu Git Menu
HTML CSS JAVASCRIPT SQL PYTHON PHP BOOTSTRAP JAVA JQUERY R React Kotlin
 

New posts in precision

How to keep float/double arithmetic deterministic?

python c precision floating-accuracy

Oracle DB returning negative scale and 0 precision using JDBC

java oracle-database jdbc precision

How to increase the precision of float values to more than 10 in python? [duplicate]

python python-2.7 python-3.x precision

How precise is numpy's sin(x) ? How do I find out? [need it to numerically solve x=a*sin(x)]

python numpy precision trigonometry numerical-methods

Why is it not possible to substract 1 from max double

c++ precision

why 0.3 + 0 == 0.3 and 0.1 + 0 == 0.1 in javascript when 0.3 and 0.1 cannot be represented exactly in binary

javascript floating-point numbers precision ieee-754

Python vs C++ Precision

python c++ precision

Is there a way to set the Floating-Point Unit's rounding mode in Java?

java floating-point precision

Precision when reading image with CLK_FILTER_LINEAR in OpenCL

image opencl gpu precision

Double to string conversion different for .NET Framework and .NET Core

c# json.net double precision

Fortran array with explicit double precision

arrays fortran double precision dimension

How to remove the .0 when reading CSV with Pandas

pandas csv decimal precision

Differing Floating Point Calculation Results between x86_64 and ARMv8.2-A

floating-point fortran arm precision

Cassandra float precision

cassandra precision cassandra-3.0

Is there any numerical-accurracy difference on calculating sin(pi/2-A) and cos(A) in Matlab?

matlab precision trigonometry latitude-longitude numerical-methods

Is there any "standard" way to calculate the numerical gradient?

c++ math precision numerical-methods

Why does np.exp(1000) give an overflow warning but np.exp(-100000) not give an underflow warning?

python numpy precision

Precision of SVG coordinates?

browser svg coordinates precision specifications

Restoring the exact angle from std::cos(angle) using std::acos

c++ std precision numerical-stability

How do I use parameter epsabs in scipy.integrate.quad in Python?

python scipy precision numerical-integration quad
« Newer Entries Older Entries »