batch work
Computational tasks that can run asynchronously over minutes or hours rather than needing immediate response, enabling cheaper serving.
As defined in Noah Shinn - Building Instinct: The Personal Agent - [Invest Like the Best, EP.493]
Where it comes up · 1
Most important claims · 1 of 1Search all claims for “batch work” →
- Instinct matches frontier-model performance on its internal evals and A/B tests at very low cost by customizing inference deployments, since non-urgent proactive work can run in batch with shapes 3x to 8x more efficient on the same compute.Noah Shinn - Building Instinct: The Personal Agent - [Invest Like the Best, EP.493]