← Jargon

Jargonmachine learning· 4 claims· 2 episodes

time to first token

The delay before an LLM starts producing output (TTFT), a key responsiveness metric for streaming answers.

As defined in Aravind Srinivas


Where it comes up · 2