Training ChatGPT requires massive amounts of internet data (trillions of tokens, at minimum high numbers of billions), distributed across hundreds or thousands of GPUs across hundreds of machines with complex infrastructure; this is out of reach for individuals and small companies.
factualpending
Speaker
Dr. Mike PoundEvidence Quote
“Massive amounts of internet data in the order of trillions, probably of tokens...hundreds and or thousands of GPUs across hundreds of machines.”
Created: 8/13/2026, 7:45:36 AM
Your notes
Loading notes...