10-18-2026, 04:10 PM
Maybe, but I had the opposite result. I get why that seems right, but on A6000 the bottleneck felt elsewhere.
small models can still be good
|
prefill/decode separation in practice on B200
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
prefill/decode separation in practice on B200 - by cacheline - 10-15-2026, 12:34 AM
Re: prefill/decode separation in practice on B200 - by thetashed24 - 10-15-2026, 12:37 PM
Re: prefill/decode separation in practice on B200 - by signalcraft14 - 10-18-2026, 12:42 PM
Re: prefill/decode separation in practice on B200 - by vrambandit - 10-18-2026, 12:57 PM
Re: prefill/decode separation in practice on B200 - by amberrunner - 10-18-2026, 02:28 PM
Re: prefill/decode separation in practice on B200 - by batchsize - 10-18-2026, 03:34 PM
Re: prefill/decode separation in practice on B200 - by batchember - 10-18-2026, 04:10 PM
|
Users browsing this thread: 1 Guest(s)