factual
Hand-Tuned Kernels Still Needed for Architecture Changes
Kernel work is not finished because new model features like changed positional embeddings (RoPE variants) break existing fused GPU kernels, forcing patches, and the ability to quickly modify kernels is valuable even though new ones are rarely invented from scratch.
factualpending
Speaker
Neil MovvaEvidence Quote
“suddenly the kernel that we had is not suitable for this new model”
Created: 11/17/2026, 6:43:49 AM
Your notes
Loading notes...