Have you ever wondered how computers store floating-point numbers like (𝝿) or (the mass of the electron in kg) in the memory which is limited by a finite number of ones and zeroes (aka bits)? 3.1415 9.109 × 10⁻³¹ It seems pretty straightforward for integers (i.e. ). Let's say we have 16 bits (2 bytes) to store the number. In 16 bits we may store the integers in a range of : 17 [0, 65535] (0000000000000000)₂ = (0)₁₀

(0000000000010001)₂ =
    (1 × 2⁴) +
    (0 × 2³) +
    (0 × 2²) +
    (0 × 2¹) +
    (1 × 2⁰) = (17)₁₀

(1111111111111111)₂ =
    (1 × 2¹⁵) +
    (1 × 2¹⁴) +
    (1 × 2¹³) +
    (1 × 2¹²) +
    (1 × 2¹¹) +
    (1 × 2¹⁰) +
    (1 × 2⁹) +
    (1 × 2⁸) +
    (1 × 2⁷) +
    (1 × 2⁶) +
    (1 × 2⁵) +
    (1 × 2⁴) +
    (1 × 2³) +
    (1 × 2²) +
    (1 × 2¹) +
    (1 × 2⁰) = (65535)₁₀ If we need a signed integer we may use and shift the range of towards the negative numbers. In this case, our 16 bits would represent the numbers in a range of . two's complement [0, 65535] [-32768, +32767] As you might have noticed, this approach won't allow you to represent numbers like (numbers after the decimal point are just being ignored). -27.15625 We're not the first ones who have noticed this issue though. Around ≈36 years ago some smart folks overcame this limitation by introducing the standard for floating-point arithmetic. IEEE 754 The IEEE 754 standard describes the way (the framework) of using those 16 bits (or 32, or 64 bits) to store the numbers of wider range, including the small floating numbers (smaller than 1 and closer to 0). To get the idea behind the standard we might recall - a way of expressing numbers that are too large or too small (usually would result in a long string of digits) to be conveniently written in decimal form. scientific notation As you may see from the image, the number representation might be split into three parts: sign - the valuable digits (the meaning, the payload) of the number fraction (aka significand) - controls how far and in which direction to move the decimal point in the fraction exponent The part we may omit by just agreeing on what it will be equal to. In our case, we'll be using as a base. base 2 Instead of using all 16 bits (or 32 bits, or 64 bits) to store the fraction of the number, we may share the bits and store a sign, exponent, and fraction at the same time. Depending on the number of bits that we're going to use to store the number we end up with the following splits: Floating-point format Total bits Sign bits Exponent bits Fraction bits Base Half-precision 16 1 5 10 2 Single-precision 32 1 8 23 2 Double-precision 64 1 11 52 2 With this approach, the number of bits for the fraction has been reduced (i.e. for the 16-bits number it was reduced from 16 bits to 10 bits). It means that the fraction might take a narrower range of values now (losing some precision). However, since we also have an exponent part, it will actually increase the ultimate number range and also allow us to describe the numbers between 0 and 1 (if the exponent is negative). For example, a signed 32-bit integer variable has a maximum value of 2³¹ − 1 = 2,147,483,647, whereas an IEEE 754 32-bit base-2 floating-point variable has a maximum value of ≈ 3.4028235 × 10³⁸. To make it possible to have a negative exponent, the IEEE 754 standard uses the . The idea is simple - subtract the bias from the exponent value to make it negative. For example, if the exponent has 5 bits, it might take the values from the range of (all values are positive here). But if we subtract the value of from it, the range will be . The number is called bias, and it is being calculated by the following formula: biased exponent [0, 31] 15 [-15, 16] 15 exponent_bias = 2 ^ (k−1) − 1

k - number of exponent bits I've tried to describe the logic behind the converting of floating-point numbers from a binary format back to the decimal format on the image below. Hopefully, it will give you a better understanding of how the IEEE 754 standard works. The 16-bits number is being used here for simplicity, but the same approach works for 32-bits and 64-bits numbers as well. Checkout the 👉🏻 to play around with setting bits on and off, and seeing how it would influence the final result interactive version of this diagram Several corner cases were omitted in the examples above for simplicity of presentation (i.e. , , and (not a number) values) -0 -∞ +∞ NaN Here is the number ranges that different floating-point formats support: Floating-point format Exp min Exp max Range Min positive Half-precision −14 +15 ±65,504 6.10 × 10⁻⁵ Single-precision −126 +127 ±3.4028235 × 10³⁸ 1.18 × 10⁻³⁸ Code examples In the , I've added a source code of binary-to-decimal converters that were used in the interactive example above. javascript-algorithms repository Below you may find an example of how to get the binary representation of the floating-point numbers in JavaScript. JavaScript is a pretty high-level language, and the example might be too verbose and not as straightforward as in lower-level languages, but still it is something you may experiment with directly in the browser: const singlePrecisionBytesLength = 4; // 32 bits
const doublePrecisionBytesLength = 8; // 64 bits
const bitsInByte = 8;

/**
 * Converts the float number into its IEEE 754 binary representation.
 * @see: https://en.wikipedia.org/wiki/IEEE_754
 *
 * @param {number} floatNumber - float number in decimal format.
 * @param {number} byteLength - number of bytes to use to store the float number.
 * @return {string} - binary string representation of the float number.
 */
function floatAsBinaryString(floatNumber, byteLength) {
  let numberAsBinaryString = '';

  const arrayBuffer = new ArrayBuffer(byteLength);
  const dataView = new DataView(arrayBuffer);

  const byteOffset = 0;
  const littleEndian = false;

  if (byteLength === singlePrecisionBytesLength) {
    dataView.setFloat32(byteOffset, floatNumber, littleEndian);
  } else {
    dataView.setFloat64(byteOffset, floatNumber, littleEndian);
  }

  for (let byteIndex = 0; byteIndex < byteLength; byteIndex += 1) {
    let bits = dataView.getUint8(byteIndex).toString(2);
    if (bits.length < bitsInByte) {
      bits = new Array(bitsInByte - bits.length).fill('0').join('') + bits;
    }
    numberAsBinaryString += bits;
  }

  return numberAsBinaryString;
}

/**
 * Converts the float number into its IEEE 754 64-bits binary representation.
 *
 * @param {number} floatNumber - float number in decimal format.
 * @return {string} - 64 bits binary string representation of the float number.
 */
function floatAs64BinaryString(floatNumber) {
  return floatAsBinaryString(floatNumber, doublePrecisionBytesLength);
}

/**
 * Converts the float number into its IEEE 754 32-bits binary representation.
 *
 * @param {number} floatNumber - float number in decimal format.
 * @return {string} - 32 bits binary string representation of the float number.
 */
function floatAs32BinaryString(floatNumber) {
  return floatAsBinaryString(floatNumber, singlePrecisionBytesLength);
}

// Usage example
floatAs32BinaryString(1.875); // -> "00111111111100000000000000000000" References You might also want to check out the following resources to get a deeper understanding of the binary representation of floating-point numbers: Here is what you need to know about JavaScript’s Number type Float Exposed IEEE754 Visualization

Different

2022 - HackerNoon Contributor of the Year - Algorithms

2022 - HackerNoon Contributor of the Year - Computer Science

2022 - HackerNoon Contributor of the Year - Github

Nominated for 2022 - HackerNoon Contributor of the Year - Algorithms

Nominated for 2022 - HackerNoon Contributor of the Year - Computer Science

Nominated for 2022 - HackerNoon Contributor of the Year - Github

Too Long; Didn't Read

Questions about cloud security? Get answers here.

An Essential Guide to Binary Representation of Floating-Point Numbers

Too Long; Didn't Read

Company Mentioned

Oleksii Trekhleb

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

An Essential Guide to Binary Representation of Floating-Point Numbers

Too Long; Didn't Read

Company Mentioned

Oleksii Trekhleb

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

RELATED STORIES