Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
eval setup for local models with TensorRT-LLM
#1
Spent some time on this today and wanted to compare notes.

I've gone back and forth between Ollama and MLX for DeepSeek. The interesting difference for me has been long context.

Interested in tradeoffs more than fan loyalty.
Reply


Messages In This Thread
eval setup for local models with TensorRT-LLM - by sparrowworks88 - 09-20-2026, 07:33 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)