Precision (computer science)

In computer science, the precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits.

Source: Wikipedia — Precision (computer science) (CC BY-SA 4.0)

Precision (computer science)

In computer science, the precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits.

Source: Wikipedia "Precision (computer science)" · CC BY-SA 4.0

Share this article: X · Bluesky
Privacy Policy