10-17-2026, 03:39 PM
A couple things I'd check first. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
|
speculative decoding in llama.cpp
|
|
« Next Oldest | Next Newest »
|