factual

Hand-Tuned Kernels Still Needed for Architecture Changes

Kernel work is not finished because new model features like changed positional embeddings (RoPE variants) break existing fused GPU kernels, forcing patches, and the ability to quickly modify kernels is valuable even though new ones are rarely invented from scratch.

factualpending

Speaker

Neil Movva

Evidence Quote

“suddenly the kernel that we had is not suitable for this new model”

Source

Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]— Invest Like the Best
Created: 11/17/2026, 6:43:49 AM

Your notes

Loading notes...