10-12-2026, 12:57 AM
Not sure I agree there. I get why that seems right, but on B200 the bottleneck felt elsewhere. Could be a workload difference, but I wouldn't generalize too fast from one setup.
queue depth watcher
|
prefill/decode separation in practice for Kimi
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)