10-16-2026, 04:39 AM
Did a bit of testing and thought I'd post the result here.
I tried this with DeepSeek using llama.cpp on A6000. The headline result was better than I expected, but long context still ended up being the limiting factor.
Happy to post more details if anyone wants them.
This is mostly for local work rather than public serving.
I tried this with DeepSeek using llama.cpp on A6000. The headline result was better than I expected, but long context still ended up being the limiting factor.
Happy to post more details if anyone wants them.
This is mostly for local work rather than public serving.
measure twice, benchmark three times