10-18-2026, 02:39 PM
Quote:same here on my side.
That matches what I was seeing. That matches what I saw on GB200. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
|
speculative decoding in llama.cpp
|
|
« Next Oldest | Next Newest »
|