Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
4090 vs 5090 for 70B quants with TensorRT-LLM
#1
I'm trying to sanity-check my setup.

My current setup is llama.cpp with 4090, and I keep running into workstation thermals.

Not looking for the perfect answer, mostly what worked in real use.
retrieval before vibes
Reply


Messages In This Thread
4090 vs 5090 for 70B quants with TensorRT-LLM - by turbogrid11 - 10-17-2026, 10:35 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)