10-16-2026, 12:40 PM
Not sure I agree there. I get why that seems right, but on 4090 the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one.
|
prefix caching in llama.cpp: worth it?
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)