vision language model
A model that relates linguistic keywords to visual landmarks, e.g., connecting the word 'apple' to its image in a robot's camera feed.
As defined in 230 | Raphaël Millière on How Artificial Intelligence Thinks
Where it comes up · 1
Most important claims · 1 of 1Search all claims for “vision language model” →
- Projects like Google's SayCan plug pretrained language models into robots to translate natural-language instructions into actionable sub-tasks using a vision-language model, but the key limitation is that these systems are not trained end-to-end through world interaction—they bolt together passively-pretrained modules—raising a deep question about whether such modular stitching, versus learning from the ground up via rich multimodal interaction, is the right model of cognition.230 | Raphaël Millière on How Artificial Intelligence Thinks