Posts: 26
Threads: 3
Joined: Aug 2026
Reputation:
0
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings. Once you know the plain path works, then add the faster path back in piece by piece.
Posts: 59
Threads: 8
Joined: Sep 2026
Reputation:
0
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec. Not glamorous advice, but repeatable baselines save a lot of time.
Posts: 44
Threads: 0
Joined: Sep 2026
Reputation:
0
worth checking the driver first.
still benchmarking everything