Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
speculative decoding in llama.cpp
#7
Thanks, that helps. That matches what I saw on GB200. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
mostly local
Reply


Messages In This Thread
speculative decoding in llama.cpp - by vrambandit - 10-06-2026, 06:29 AM
Re: speculative decoding in llama.cpp - by macroforge - 10-06-2026, 10:24 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)