little utility you keep installed: what are you seeing?

[quantyard]

I think the bottleneck is somewhere else. I've seen people blame prefill/decode split when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.