+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: TensorRT-LLM (https://www.datasculpting.ai/inference/forumdisplay.php?fid=37)
+--- Thread: quant support gaps (/showthread.php?tid=1242)
quant support gaps - torchtrack24 - 10-15-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between Ollama and vLLM for FLUX. The interesting difference for me has been MoE serving.
Interested in tradeoffs more than fan loyalty.
Re: quant support gaps - syshouse - 10-15-2026
I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.