Semantic
Relating to meaning in language; semantic knowledge refers to understanding what words and sentences mean, as opposed to just their structure or surface form
As defined in What Is ChatGPT Doing? Episode 1: Introduction
Other definitions
Relating to meaning or interpretation, as opposed to syntax (structure); semantic understanding refers to comprehending what something means
The Future of Knowledge Graphs in a World of Large Language Models
Where it comes up · 2
- What Is ChatGPT Doing? Episode 1: Introduction2 claims
- Sam Altman and Greg Brockman on AI and the Future (Full Audio)1 claim
Most important claims · 3 of 3Search all claims for “Semantic” →
- GPT-4 enables semantic understanding and capabilities to emerge from syntactic tasks—as demonstrated in the 2017 'Unsupervised Sentiment Neuron' paper where a model trained to predict the next character in Amazon reviews learned state-of-the-art sentiment classification without explicit instruction.Sam Altman and Greg Brockman on AI and the Future (Full Audio)
- A language model models language and contains inside of it an abstraction of semantic and syntactic knowledge that is not explicitly given as input but must be stored within the model's internal structureWhat Is ChatGPT Doing? Episode 1: Introduction
- Large language models require large size because small models do not contain enough parameters to encode all grammatical and semantic relationships necessary to model language properly, though future research may find ways to compress them more efficientlyWhat Is ChatGPT Doing? Episode 1: Introduction