|
eval setup for local models for Kimi
|
09-27-2026, 05:16 AM
Quote:Quote:Curious what people here are seeing. I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
measure twice, benchmark three times
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
eval setup for local models for Kimi - by batchsize - 09-25-2026, 04:02 AM
Re: eval setup for local models for Kimi - by audionode8 - 09-25-2026, 04:34 PM
Re: eval setup for local models for Kimi - by cacheline - 09-27-2026, 05:16 AM
Re: eval setup for local models for Kimi - by batchpeak - 09-27-2026, 09:24 AM
Re: eval setup for local models for Kimi - by routearch - 10-01-2026, 09:47 AM
Re: eval setup for local models for Kimi - by kernelghost - 09-30-2026, 09:43 AM
Re: eval setup for local models for Kimi - by nanobrook - 09-30-2026, 10:44 AM
Re: eval setup for local models for Kimi - by audioforge - 09-30-2026, 06:50 PM
Re: eval setup for local models for Kimi - by cacheline - 09-30-2026, 09:21 PM
Re: eval setup for local models for Kimi - by kernelghost - 10-01-2026, 05:36 AM
Re: eval setup for local models for Kimi - by batchfield55 - 10-01-2026, 06:56 AM
|
