hybrid retrieval results: setup advice

[tinycontext]

Curious what people here are seeing.

My current setup is LM Studio with 7900 XTX, and I keep running into NVFP4.

If you've tested something similar, what did you keep and what did you stop bothering with?

I expected the biggest difference to come from the model, but the stack around it mattered at least as much.

[nanogarden]

I don't think that's the whole story. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.

[orbitgarden]

same here on my side. I keep promising myself this is the last rebuild.