Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
prefix caching on repeated workflows on GB200
#12
Interesting, I hadn't tried that. I ended up in about the same place using Ollama. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
small models can still be good
Reply


Messages In This Thread
Re: prefix caching on repeated workflows on GB200 - by localtinker - 10-04-2026, 12:12 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)