Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
routing between local and hosted: what are you seeing?
#4
Interesting, I hadn't tried that. I ended up in about the same place using TensorRT-LLM. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.

If you post your exact settings, people here can probably narrow it down pretty fast.
mostly local
Reply


Messages In This Thread
Re: routing between local and hosted: what are you seeing? - by signalpeak - 10-16-2026, 06:07 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)