factual

Pretrain Robots' Transformers on Text First

Robotics transformers such as Google's RT-1 benefit from pretraining on huge text corpora to build world understanding, then adding robotic sensor inputs as another modality, which transformers handle naturally.

factualpending

Speaker

Gavin

Evidence Quote

“they pretrained the model with a huge amount of text, where they have built some understanding of the world”

Source

Gavin Uberti - Real-Time AI & The Future of AI Hardware - [Invest Like the Best, EP.356]— Invest Like the Best
Created: 11/17/2026, 12:35:53 PM

Your notes

Loading notes...