Inference › Inference Engines › TensorRT-LLM v
quant support gaps

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
quant support gaps
torchtrack24 Offline
Junior Member
**
Posts: 33
Threads: 4
Joined: Sep 2026
Reputation: 0
#1
10-15-2026, 04:36 AM
Spent some time on this today and wanted to compare notes.

I've gone back and forth between Ollama and vLLM for FLUX. The interesting difference for me has been MoE serving.

Interested in tradeoffs more than fan loyalty.
trying not to rebuild again
Find
Reply


Messages In This Thread
quant support gaps - by torchtrack24 - 10-15-2026, 04:36 AM
Re: quant support gaps - by syshouse - 10-15-2026, 06:01 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)