The most recent change is that multimodal LLMs contain common-sense knowledge that can be pulled into robots to handle unusual situations, but they are poorly grounded in physical situations and must be plugged in carefully, since they lack robot context.
causalpending
Speaker
Sergey LevineEvidence Quote
“multimodal language models are really good at pulling in knowledge... They're not very good at like grounding that knowledge in physical situations”
Created: 11/11/2026, 5:04:53 AM
Your notes
Loading notes...