Inference › Inference Engines › llama.cpp / GGUF v
prefix caching in llama.cpp with MLX

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
prefix caching in llama.cpp with MLX
thetagrid15 Offline
Member
***
Posts: 68
Threads: 3
Joined: Sep 2026
Reputation: 0
#1
09-22-2026, 11:23 PM
Spent some time on this today and wanted to compare notes.

I've gone back and forth between llama.cpp and PyTorch for FLUX. The interesting difference for me has been long context.

Trying to avoid rebuilding the whole thing twice.
Find
Reply


Messages In This Thread
prefix caching in llama.cpp with MLX - by thetagrid15 - 09-22-2026, 11:23 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)