Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
CUDA update broke my throughput
#1
Curious what people here are seeing.

I'm mostly working with Kimi in PyTorch on B200. The part I'm trying to understand is INT4.

If you've tested something similar, what did you keep and what did you stop bothering with?

This is mostly for local work rather than public serving.

If I had to summarize the lesson so far, it would be that clean setup and observability beat clever guesses.
Reply


Messages In This Thread
CUDA update broke my throughput - by cobaltspark - 10-18-2026, 05:15 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)