The AI Hacker
- Apr 28, 2020
Illustrated Guide to Transformers Neural Network: A step by step explanation
This is a 15-minute illustrated walkthrough of the transformer architecture, narrated by a single speaker who is not identified. It starts from the weakness of recurrent networks: RNNs have a short reference window, and…