HN.zip

Make this forward pass as fast as possible

22 points by - 2 comments
[3 hidden]5 mins ago
If AI models were trained for optimising kernels, they could easily replace ML compilers. With no branches a numerical check gives you the correctness guarantees you need. However we already see anthropic deliberately nerfing kernel optimisation capabilities of their latest models, Chinese AI companies on the other hand have the opposite incentive.
[3 hidden]5 mins ago
As someone who doesn't know much about kernels and compilation, this reads like a modern-day Retroencabulator