prefill/decode separation in practice

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Linear Mode

prefill/decode separation in practice

phaseport36 Offline

Member

Posts: 62
Threads: 4
Joined: Sep 2026
Reputation: 0

10-13-2026, 04:39 AM

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.

Find

« Next Oldest | Next Newest »

Messages In This Thread

prefill/decode separation in practice - by thetaplane - 10-12-2026, 03:30 PM

Re: prefill/decode separation in practice - by kernelgrid - 10-13-2026, 03:46 AM

Re: prefill/decode separation in practice - by phaseport36 - 10-13-2026, 04:39 AM

Re: prefill/decode separation in practice - by cacheline - 10-13-2026, 05:04 AM

Re: prefill/decode separation in practice - by phasestream53 - 10-13-2026, 05:39 AM

Re: prefill/decode separation in practice - by batchsize - 10-13-2026, 06:12 AM

Re: prefill/decode separation in practice - by amberrunner - 10-13-2026, 07:44 AM

Re: prefill/decode separation in practice - by turboarch95 - 10-13-2026, 11:47 AM

Re: prefill/decode separation in practice - by ggufvault - 10-13-2026, 01:27 PM

Re: prefill/decode separation in practice - by kernelmike - 10-13-2026, 02:09 PM

Re: prefill/decode separation in practice - by turboarch95 - 10-18-2026, 05:58 AM

Re: prefill/decode separation in practice - by turboarch95 - 10-13-2026, 02:30 PM

Re: prefill/decode separation in practice - by cacheline - 10-16-2026, 02:56 PM

Re: prefill/decode separation in practice - by oxidemixer - 10-18-2026, 03:36 AM

View a Printable Version

Forum Jump:

Users browsing this thread: 1 Guest(s)

Login
Username:
Password:	Lost Password?
	Remember me

Sign in with X.com