Inference › Optimization & Performance › Context / KV Cache v
draft model choices

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
draft model choices
cacheline Offline
Senior Member
****
Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0
#4
09-27-2026, 07:21 AM
Not sure I agree there. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
measure twice, benchmark three times
Find
Reply


Messages In This Thread
draft model choices - by cacheline - 09-26-2026, 05:01 AM
Re: draft model choices - by cacheline - 09-26-2026, 05:43 AM
Re: draft model choices - by llmarch51 - 09-26-2026, 06:33 PM
Re: draft model choices - by cacheline - 09-27-2026, 07:21 AM
Re: draft model choices - by cobaltlab - 09-27-2026, 07:58 AM
Re: draft model choices - by cacheline - 09-27-2026, 10:42 AM
Re: draft model choices - by relaynest82 - 09-27-2026, 12:44 PM
Re: draft model choices - by cacheline - 09-27-2026, 01:49 PM
Re: draft model choices - by torchtrack24 - 09-27-2026, 03:05 PM
Re: draft model choices - by amberkite - 09-27-2026, 04:20 PM
Re: draft model choices - by cacheline - 09-28-2026, 04:52 AM
Re: draft model choices - by bytepilot - 09-28-2026, 01:40 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)