Training ChatGPT requires massive amounts of internet data (trillions of tokens, at minimum high numbers of billions), distributed across hundreds or thousands of GPUs across hundreds of machines with complex infrastructure; this is out of reach for individuals and small companies.

factualpending

Speaker

Dr. Mike Pound

Evidence Quote

“Massive amounts of internet data in the order of trillions, probably of tokens...hundreds and or thousands of GPUs across hundreds of machines.”

Source

You need to learn AI in 2024! (And here is your roadmap)— David Bombal
Created: 8/13/2026, 7:45:36 AM

Your notes

Loading notes...