09-15-2026, 06:20 AM
Ran a quick check on my box. On Threadripper box with Ollama, I saw basically the same behavior. I expected the model choice to matter more than it did.
still benchmarking everything
|
prefix caching on repeated workflows
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
prefix caching on repeated workflows - by cacheline - 09-14-2026, 08:50 PM
Re: prefix caching on repeated workflows - by cacheline - 09-15-2026, 05:31 AM
Re: prefix caching on repeated workflows - by labline - 09-15-2026, 06:20 AM
|
Users browsing this thread: 2 Guest(s)