factual
Pretrain Robots' Transformers on Text First
Robotics transformers such as Google's RT-1 benefit from pretraining on huge text corpora to build world understanding, then adding robotic sensor inputs as another modality, which transformers handle naturally.
factualpending
Speaker
GavinEvidence Quote
“they pretrained the model with a huge amount of text, where they have built some understanding of the world”
Source
Gavin Uberti - Real-Time AI & The Future of AI Hardware - [Invest Like the Best, EP.356]— Invest Like the BestCreated: 11/17/2026, 12:35:53 PM
Your notes
Loading notes...