Inference › Optimization & Performance › Quantization v
best small quant that still feels smart for Kimi

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
best small quant that still feels smart for Kimi
vrambandit Offline
Member
***
Posts: 168
Threads: 14
Joined: Sep 2026
Reputation: 0
#4
10-13-2026, 07:19 AM
What worked for me was pretty simple. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
2x3090 • llama.cpp • too much VRAM is still not enough
Find
Reply


Messages In This Thread
Re: best small quant that still feels smart for Kimi - by vrambandit - 10-13-2026, 07:19 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)