Inference › Inference Engines › llama.cpp / GGUF v
prefix caching in llama.cpp with MLX

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
prefix caching in llama.cpp with MLX
kernelmike Offline
Member
***
Posts: 184
Threads: 23
Joined: Sep 2026
Reputation: 0
#7
09-26-2026, 07:18 PM
Maybe, but I had the opposite result. I've seen people blame workstation thermals when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
Mostly CUDA, sometimes wrong, usually measured
Find
Reply


Messages In This Thread
Re: prefix caching in llama.cpp with MLX - by kernelmike - 09-26-2026, 07:18 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)