Posts: 38
Threads: 5
Joined: Sep 2026
Reputation:
0
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like small local stacks decides everything downstream.
Wondering if this is just where the whole space is heading now. I keep promising myself this is the last rebuild.
Posts: 59
Threads: 7
Joined: Oct 2026
Reputation:
0
A couple things I'd check first. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
learning in public
Posts: 31
Threads: 2
Joined: Oct 2026
Reputation:
0
What worked for me was pretty simple. On mini PC, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Posts: 43
Threads: 8
Joined: Sep 2026
Reputation:
0
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher.
Posts: 45
Threads: 2
Joined: Aug 2026
Reputation:
0
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks.
Posts: 59
Threads: 8
Joined: Sep 2026
Reputation:
0
following this because I'm in the same boat.
Posts: 41
Threads: 5
Joined: Aug 2026
Reputation:
0
Thanks, that helps. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Posts: 47
Threads: 6
Joined: Sep 2026
Reputation:
0
A couple things I'd check first. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
