Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
prefill/decode separation in practice for Kimi
#11
Quote:I hit almost the same issue last night.

What worked for me was pretty simple. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
mostly local
Reply


Messages In This Thread
Re: prefill/decode separation in practice for Kimi - by vramport - 10-17-2026, 11:21 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)