KDA²: Kernel Design Agents (KDA) optimize Kimi Delta Attention (KDA) | KDA Blog
nvlabs.github.io · saved by 1 readers
Our agents wrote Kimi Delta Attention kernels that run up to 2.96× faster than FlashKDA on B300 with a tenth of its state error. Here is how, and how the agents tried to cheat along the way.