10-06-2026, 09:07 PM
I tested this tonight. On Threadripper box with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
Inference
›
Drivers / Frameworks / Toolkits
›
NVIDIA / CUDA
CUDA update broke my throughput for Kimi
CUDA update broke my throughput for Kimi
|
CUDA update broke my throughput for Kimi
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
CUDA update broke my throughput for Kimi - by kernelmike - 10-03-2026, 06:30 PM
Re: CUDA update broke my throughput for Kimi - by kernelmike - 10-05-2026, 06:39 PM
Re: CUDA update broke my throughput for Kimi - by nanopatch - 10-05-2026, 08:47 PM
Re: CUDA update broke my throughput for Kimi - by edgecoast - 10-06-2026, 09:07 PM
Re: CUDA update broke my throughput for Kimi - by amberpatch25 - 10-07-2026, 09:51 AM
Re: CUDA update broke my throughput for Kimi - by dockember - 10-07-2026, 06:13 PM
Re: CUDA update broke my throughput for Kimi - by phaseport36 - 10-10-2026, 07:03 PM
Re: CUDA update broke my throughput for Kimi - by kernelmike - 10-10-2026, 08:26 PM
Re: CUDA update broke my throughput for Kimi - by phaseport36 - 10-11-2026, 08:31 AM
Re: CUDA update broke my throughput for Kimi - by orbitbench6 - 10-11-2026, 01:11 PM
Re: CUDA update broke my throughput for Kimi - by kernelmike - 10-13-2026, 01:23 AM
|
Users browsing this thread: 1 Guest(s)