Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
which local open model do you keep coming back to: what are you seeing?
#1
Did a bit of testing and thought I'd post the result here.

I tried this with Llama using SGLang on 7900 XTX. The headline result was better than I expected, but continuous batching still ended up being the limiting factor.

Curious if anyone else landed in the same place.
curious and caffeinated
Reply


Messages In This Thread
which local open model do you keep coming back to: what are you seeing? - by promptfield - 09-16-2026, 05:35 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)