Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
4090 vs 5090 for 70B quants with TensorRT-LLM
#12
Appreciate the detail. The pattern around router policy has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
still benchmarking everything
Reply


Messages In This Thread
Re: 4090 vs 5090 for 70B quants with TensorRT-LLM - by fusedhall56 - 10-19-2026, 04:00 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)