quant support gaps

[torchtrack24]

Spent some time on this today and wanted to compare notes.

I've gone back and forth between Ollama and vLLM for FLUX. The interesting difference for me has been MoE serving.

Interested in tradeoffs more than fan loyalty.

[syshouse]

I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.