Early work in tool use originated from the computer vision community because before large language models could process images, the only option was for LMs to generate function calls that could manipulate images (generate, detect objects, etc.).
causalpending
Speaker
Andrew NgEvidence Quote
“it turns out that a lot of the early work in two use turned out to be in the computer vision Community because before large language models lm's you know they couldn't do anything with images so the only option was that the LM generate a function called that could manipulate an image”
Created: 8/11/2026, 1:37:51 AM
Your notes
Loading notes...