quantized
A model whose weights have been reduced to lower numerical precision to save memory/compute, potentially at some cost to accuracy.
As defined in Cursor Team
Where it comes up · 2
Most important claims · 3 of 3Search all claims for “quantized” →
- The Stern-Gerlach experiment of 1922 found that when silver atoms (whose spin came entirely from one unpaired electron in the outer shell) passed through a strong inhomogeneous magnetic field, the beam split into exactly two lines, demonstrating that spin angular momentum is quantized.Quantum computing in the 21st Century – with David Jamieson
- In 1959, Richard Feynman gave a remarkable lecture titled 'There's Plenty of Room at the Bottom' proposing the idea of building a computer employing quantum spins as bits instead of classical bits, which would allow using a quantum system to model another quantum system—an idea with no technology to implement it in 1959.Quantum computing in the 21st Century – with David Jamieson
- Claude's occasionally degraded performance may be explained by AWS using different chips (Bedrock) with slightly different numerics than Nvidia GPUs, possibly running a quantized version of the model versus the version on Anthropic's GPUs.Cursor Team