The most recent change is that multimodal LLMs contain common-sense knowledge that can be pulled into robots to handle unusual situations, but they are poorly grounded in physical situations and must be plugged in carefully, since they lack robot context.

causalpending

Speaker

Sergey Levine

Evidence Quote

“multimodal language models are really good at pulling in knowledge... They're not very good at like grounding that knowledge in physical situations”

Source

World's Top Researcher on AI, LLMs, and Robot Intelligence— Invest Like The Best
Created: 11/11/2026, 5:04:53 AM

Your notes

Loading notes...