Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
eval setup for local models with TensorRT-LLM
#5
Quote:I'd start with the simpler stack.

Interesting, I hadn't tried that. I ended up in about the same place using llama.cpp. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
measure twice, benchmark three times
Reply


Messages In This Thread
Re: eval setup for local models with TensorRT-LLM - by cacheline - 09-23-2026, 12:36 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)