prefill/decode separation in practice for Kimi

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

prefill/decode separation in practice for Kimi

rocmrunner40 Offline

Offline

Member

Posts: 57
Threads: 8
Joined: Oct 2026
Reputation: 0

#2

10-11-2026, 12:11 PM

Quote:Wanted to compare notes with people doing similar things.

Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?

Find

Reply

« Next Oldest | Next Newest »

Messages In This Thread

prefill/decode separation in practice for Kimi - by batchsize - 10-11-2026, 10:24 AM

Re: prefill/decode separation in practice for Kimi - by rocmrunner40 - 10-11-2026, 12:11 PM

Re: prefill/decode separation in practice for Kimi - by nanogarden - 10-18-2026, 11:55 PM

Re: prefill/decode separation in practice for Kimi - by promptpoint - 10-12-2026, 12:57 AM

Re: prefill/decode separation in practice for Kimi - by mangofield33 - 10-13-2026, 07:32 PM

Re: prefill/decode separation in practice for Kimi - by signalcraft14 - 10-12-2026, 02:25 AM

Re: prefill/decode separation in practice for Kimi - by batchsize - 10-13-2026, 03:07 PM

Re: prefill/decode separation in practice for Kimi - by routearch - 10-13-2026, 03:51 PM

Re: prefill/decode separation in practice for Kimi - by vramport - 10-17-2026, 11:21 AM

Re: prefill/decode separation in practice for Kimi - by turboarch95 - 10-13-2026, 06:11 PM

Re: prefill/decode separation in practice for Kimi - by rocmmixer - 10-14-2026, 08:06 AM

Re: prefill/decode separation in practice for Kimi - by mangofield33 - 10-17-2026, 08:49 AM

Re: prefill/decode separation in practice for Kimi - by promptpoint - 10-19-2026, 05:23 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)