disaggregated inference thoughts with llama.cpp

[kernelrunner]

I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit. Worth testing

Maybe, but I had the opposite result. I've seen people blame INT4 when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.