Inference › Inference Engines › llama.cpp / GGUF v
speculative decoding in llama.cpp on dual 3090

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
speculative decoding in llama.cpp on dual 3090
visionforge Offline
Member
***
Posts: 121
Threads: 15
Joined: Sep 2026
Reputation: 0
#4
10-18-2026, 03:41 AM
That matches what I was seeing. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
image models by night, local pipelines by day
Find
Reply


Messages In This Thread
Re: speculative decoding in llama.cpp on dual 3090 - by visionforge - 10-18-2026, 03:41 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)