Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
speculative decoding in llama.cpp
#12
What worked for me was pretty simple. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Reply


Messages In This Thread
Re: speculative decoding in llama.cpp - by thetagrid15 - 10-15-2026, 04:57 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)