Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
speculative decoding in llama.cpp
#5
A couple things I'd check first. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Reply


Messages In This Thread
speculative decoding in llama.cpp - by vrambandit - 10-13-2026, 12:19 AM
Re: speculative decoding in llama.cpp - by dockridge - 10-17-2026, 03:39 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)