10-19-2026, 05:13 AM
A couple questions before I guess too hard. Are you testing this on B200 or something else?
small models can still be good
|
prefill/decode separation in practice
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
prefill/decode separation in practice - by cacheline - 10-17-2026, 07:37 PM
Re: prefill/decode separation in practice - by localtinker - 10-19-2026, 05:13 AM
Re: prefill/decode separation in practice - by oxidemixer - 10-19-2026, 05:38 AM
|
Users browsing this thread: 1 Guest(s)