Inference › Inference Engines › vLLM / SGLang v
why did throughput drop after update for Kimi

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
why did throughput drop after update for Kimi
labpath Offline
Junior Member
**
Posts: 24
Threads: 2
Joined: Aug 2026
Reputation: 0
#1
10-11-2026, 05:35 AM
I'm trying to sanity-check my setup.

I'm mostly working with Qwen in TensorRT-LLM on A6000. The part I'm trying to understand is speculative decoding.

Would appreciate practical advice rather than theory.
Find
Reply


Messages In This Thread
why did throughput drop after update for Kimi - by labpath - 10-11-2026, 05:35 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)