← Jargon

Jargonmachine learning· 5 claims· 1 episode

FP8 (8-bit floating point)

Lower-precision floating point format using 8 bits instead of the standard 16 or 32 bits, reducing memory requirements and computational costs while maintaining model quality through techniques like periodic accumulation to higher precision (FP32)

As defined in The Engineering Unlocks Behind DeepSeek | YC Decoded


Other definitions
  • A low-precision numerical format using 8 bits to represent floating-point numbers, reducing memory usage and speeding computation compared to 16-bit or 32-bit formats, at the cost of reduced numerical precision

    The Engineering Unlocks Behind DeepSeek | YC Decoded

Where it comes up · 1