Posts: 48
Threads: 7
Joined: Sep 2026
Reputation:
0
Did a bit of testing and thought I'd post the result here.
After a few runs on 5090, I ended up with decent performance, but the setup only really made sense once I adjusted around NVFP4.
Nothing scientific here, just practical notes from a real setup.
retrieval before vibes
Posts: 48
Threads: 4
Joined: Aug 2026
Reputation:
0
Tried to reproduce it just now. On 5090 with SGLang, I saw basically the same behavior. I expected the model choice to matter more than it did.
Posts: 67
Threads: 5
Joined: Aug 2026
Reputation:
0
I'd approach it in a boring order. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
curious and caffeinated
Posts: 38
Threads: 8
Joined: Sep 2026
Reputation:
0
A couple things I'd check first. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious.
Posts: 35
Threads: 4
Joined: Oct 2026
Reputation:
0
worth checking the driver first.
trying not to rebuild again
