← Jargon

JargonAI performance metrics· 7 claims· 6 episodes

tokens per second

A measure of how fast a language model generates text, indicating the number of individual tokens (words or subwords) produced by the model in one second

As defined in Feed Your OWN Documents to a Local Large Language Model!


Other definitions

Where it comes up · 6