10-14-2026, 02:35 AM
Can you fill in a bit more context? Are you testing this on B200 or something else?
measure twice, benchmark three times
Inference
›
Optimization & Performance
›
Context / KV Cache
prefix caching on repeated workflows for Gemma
prefix caching on repeated workflows for Gemma
|
prefix caching on repeated workflows for Gemma
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
prefix caching on repeated workflows for Gemma - by deepseeked - 10-13-2026, 08:29 AM
Re: prefix caching on repeated workflows for Gemma - by cacheline - 10-13-2026, 12:38 PM
Re: prefix caching on repeated workflows for Gemma - by pixelcrate82 - 10-13-2026, 01:36 PM
Re: prefix caching on repeated workflows for Gemma - by cacheline - 10-14-2026, 02:35 AM
Re: prefix caching on repeated workflows for Gemma - by cacheline - 10-13-2026, 02:28 PM
Re: prefix caching on repeated workflows for Gemma - by modbench - 10-15-2026, 02:47 AM
Re: prefix caching on repeated workflows for Gemma - by cacheline - 10-15-2026, 07:37 AM
|
Users browsing this thread: 1 Guest(s)