Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Tensor cores actually helping here with LM Studio
#6
Quote:A couple questions before I guess too hard. What model, what runtime, and roughly what context size?

Thanks, that helps. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Mostly CUDA, sometimes wrong, usually measured
Reply


Messages In This Thread
Re: Tensor cores actually helping here with LM Studio - by kernelmike - 10-15-2026, 02:14 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)