The questioner notes that the ability to achieve with prompt engineering and in-context learning grows disproportionately with model size (e.g., going from 1B to 175B to 1T parameters yields super-linear improvements in what you can do without retraining).

factualpending

Speaker

Unidentified Speaker — Breakthrough potential of AI | Sam Altman | MIT 2023 [T5cPoNwO7II]

Evidence Quote

“regardless of the specifics the trend is toward as the models are getting bigger and bigger and bigger so you go from one trillion to 10 trillion parameters the amount you can achieve with just changing uh prompt engineering or changing the the tokens that are feeding into it is growing disproportionately to the model size does that sound right”

Source

Breakthrough potential of AI | Sam Altman | MIT 2023— Imagination in Action
Created: 8/10/2026, 10:46:10 PM

Your notes

Loading notes...