In the comments it reads like bonsei falls apart on longer running tasks.
txrx0000 [3 hidden]5 mins ago
Not really. The largest IQ4_XS quant here is still worth it because Bonsai doesn't offer larger quants. They could beat it if they made a quaternary variant though, I don't know why they're stopping at ternary.
Disclarer: I'm unsing Vulkan on an AMD GC.
https://news.ycombinator.com/item?id=49746618