Inference › LLM Models › Open Weight › Local v
setup notes worth sharing: what are you seeing?

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
setup notes worth sharing: what are you seeing?
rocmhouse90 Offline
Member
***
Posts: 63
Threads: 1
Joined: Sep 2026
Reputation: 0
#8
10-04-2026, 06:20 AM
Quote:My first guess would be this: If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious.

Can you fill in a bit more context? Is this local-only or are you routing anything externally?

If you post your exact settings, people here can probably narrow it down pretty fast.
still benchmarking everything
Find
Reply


Messages In This Thread
Re: setup notes worth sharing: what are you seeing? - by rocmhouse90 - 10-04-2026, 06:20 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)