09-30-2026, 04:16 PM
Thanks, that helps. The pattern around prefill/decode split has been pretty similar for me.
curious and caffeinated
|
eval setup for local models: setup advice
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
eval setup for local models: setup advice - by batchsize - 09-27-2026, 02:28 AM
Re: eval setup for local models: setup advice - by circuitworks90 - 09-27-2026, 06:59 AM
Re: eval setup for local models: setup advice - by cacheline - 09-30-2026, 07:07 AM
Re: eval setup for local models: setup advice - by circuitworks90 - 09-30-2026, 07:50 AM
Re: eval setup for local models: setup advice - by labline - 10-01-2026, 04:55 PM
Re: eval setup for local models: setup advice - by routearch - 09-30-2026, 12:14 PM
Re: eval setup for local models: setup advice - by kernelpeak - 09-30-2026, 04:16 PM
|
Users browsing this thread: 1 Guest(s)