|
prefill/decode separation in practice on B200
|
10-15-2026, 12:37 PM
Quote:Thought I'd post a small recipe because a lot of threads ask similar things. Interesting, I hadn't tried that. I ended up in about the same place using LM Studio. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
learning in public
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
prefill/decode separation in practice on B200 - by cacheline - 10-15-2026, 12:34 AM
Re: prefill/decode separation in practice on B200 - by thetashed24 - 10-15-2026, 12:37 PM
Re: prefill/decode separation in practice on B200 - by signalcraft14 - 10-18-2026, 12:42 PM
Re: prefill/decode separation in practice on B200 - by vrambandit - 10-18-2026, 12:57 PM
Re: prefill/decode separation in practice on B200 - by amberrunner - 10-18-2026, 02:28 PM
Re: prefill/decode separation in practice on B200 - by batchsize - 10-18-2026, 03:34 PM
Re: prefill/decode separation in practice on B200 - by batchember - 10-18-2026, 04:10 PM
|
