Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargontechnology· 1 claim· 1 episode

vision language model

A model that relates linguistic keywords to visual landmarks, e.g., connecting the word 'apple' to its image in a robot's camera feed.

As defined in 230 | Raphaël Millière on How Artificial Intelligence Thinks


Where it comes up · 1
  • 230 | Raphaël Millière on How Artificial Intelligence Thinks1 claim

Most important claims · 1 of 1Search all claims for “vision language model” →
  • Projects like Google's SayCan plug pretrained language models into robots to translate natural-language instructions into actionable sub-tasks using a vision-language model, but the key limitation is that these systems are not trained end-to-end through world interaction—they bolt together passively-pretrained modules—raising a deep question about whether such modular stitching, versus learning from the ground up via rich multimodal interaction, is the right model of cognition.230 | Raphaël Millière on How Artificial Intelligence Thinks