best small quant that still feels smart

[paperrunner]

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings. Once you know

subscribed, curious where this lands.