Half-precision floating-point format

Half precision (sometimes called FP16 or float16) is a binary floating-point computer number format that occupies 16 bits (two bytes in modern computers) in computer memory.

Uses your system voice; voice and rate in settings.

Snapshot

≈ 2 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

Half precision (sometimes called FP16 or float16) is a binary floating-point computer number format that occupies 16 bits (two bytes in modern computers) in computer memory. It is intended for storage of floating-point values in applications where higher precision is not essential, in particular image processing and neural networks.

Almost all modern uses follow the IEEE 754-2008 standard, where the 16-bit base-2 format is referred to as binary16, and the exponent uses 5 bits. This can express values in the range ±65,504, with the minimum value above 1 being 1 + 1/1024.

E min = 00001 2 − 01111 2 = −14 E max = 11110 2 − 01111 2 = 15 Exponent bias = 01111 2 = 15 Thus, as defined by the offset binary representation, in order to get the true exponent the offset of 15 has to be subtracted from the stored exponent. The stored exponents 00000 2 and 11111 2 are interpreted specially. The minimum strictly positive (subnormal) value is 2 −24 ≈ 5.96 × 10 −8 .

The minimum positive normal value is 2 −14 ≈ 6.10 × 10 −5 . The maximum representable value is (2−2 −10 ) × 2 15 = 65504.

Text derived from https://en.wikipedia.org/w/index.php?oldid=1378892203 under CC BY-SA 4.0; modifications have been made.

Sources cited in this revision

29 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.