Processing Units
The individual computational elements in a neural network that perform mathematical operations; adding more processing units increases the model's capacity and ability to learn complex patterns
As defined in What Is ChatGPT Doing? Episode 1: Introduction
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “Processing Units” →
- Neural networks are parameterized and scalable—they have processing units that can be added to increase capacity, similar to how biological organisms scale proportionally as they grow (e.g., a growing baby has larger arms and a bigger heart)What Is ChatGPT Doing? Episode 1: Introduction
- Neural networks can be set up to reprocess text multiple times, adding more processing units and parameters each time, which increases the depth and capacity of the modelWhat Is ChatGPT Doing? Episode 1: Introduction