09-27-2026, 09:24 AM
Appreciate the detail. I ended up in about the same place using TensorRT-LLM. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
trying not to rebuild again
|
eval setup for local models for Kimi
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
eval setup for local models for Kimi - by batchsize - 09-25-2026, 04:02 AM
Re: eval setup for local models for Kimi - by audionode8 - 09-25-2026, 04:34 PM
Re: eval setup for local models for Kimi - by cacheline - 09-27-2026, 05:16 AM
Re: eval setup for local models for Kimi - by batchpeak - 09-27-2026, 09:24 AM
Re: eval setup for local models for Kimi - by routearch - 10-01-2026, 09:47 AM
Re: eval setup for local models for Kimi - by kernelghost - 09-30-2026, 09:43 AM
Re: eval setup for local models for Kimi - by nanobrook - 09-30-2026, 10:44 AM
Re: eval setup for local models for Kimi - by audioforge - 09-30-2026, 06:50 PM
Re: eval setup for local models for Kimi - by cacheline - 09-30-2026, 09:21 PM
Re: eval setup for local models for Kimi - by kernelghost - 10-01-2026, 05:36 AM
Re: eval setup for local models for Kimi - by batchfield55 - 10-01-2026, 06:56 AM
|
Users browsing this thread: 1 Guest(s)