Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargonmachine learning infrastructure· 1 claim· 1 episode

batch work

Computational tasks that can run asynchronously over minutes or hours rather than needing immediate response, enabling cheaper serving.

As defined in Noah Shinn - Building Instinct: The Personal Agent - [Invest Like the Best, EP.493]


Where it comes up · 1
  • Noah Shinn - Building Instinct: The Personal Agent - [Invest Like the Best, EP.493]1 claim

Most important claims · 1 of 1Search all claims for “batch work” →
  • Instinct matches frontier-model performance on its internal evals and A/B tests at very low cost by customizing inference deployments, since non-urgent proactive work can run in batch with shapes 3x to 8x more efficient on the same compute.Noah Shinn - Building Instinct: The Personal Agent - [Invest Like the Best, EP.493]