Inference › Optimization & Performance › Context / KV Cache v
draft model choices

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
draft model choices
cacheline Offline
Senior Member
****
Posts: 341
Threads: 51
Joined: Sep 2026
Reputation: 0
#2
09-26-2026, 05:43 AM
Quote:Posting this in case it saves someone else a little time.

Appreciate the detail. That matches what I saw on 5090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
measure twice, benchmark three times
Find
Reply


Messages In This Thread
draft model choices - by cacheline - 09-26-2026, 05:01 AM
Re: draft model choices - by cacheline - 09-26-2026, 05:43 AM
Re: draft model choices - by llmarch51 - 09-26-2026, 06:33 PM
Re: draft model choices - by cacheline - 09-27-2026, 07:21 AM
Re: draft model choices - by cobaltlab - 09-27-2026, 07:58 AM
Re: draft model choices - by cacheline - 09-27-2026, 10:42 AM
Re: draft model choices - by relaynest82 - 09-27-2026, 12:44 PM
Re: draft model choices - by cacheline - 09-27-2026, 01:49 PM
Re: draft model choices - by torchtrack24 - 09-27-2026, 03:05 PM
Re: draft model choices - by amberkite - 09-27-2026, 04:20 PM
Re: draft model choices - by cacheline - 09-28-2026, 04:52 AM
Re: draft model choices - by bytepilot - 09-28-2026, 01:40 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)