08-31-2026, 06:18 AM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
mostly local
Inference
›
Inference Engines
›
Ollama / LM Studio / Desktop Runtimes
best local runtime for mixed models for Mixtral
best local runtime for mixed models for Mixtral
|
best local runtime for mixed models for Mixtral
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
best local runtime for mixed models for Mixtral - by llm_wren - 08-31-2026, 05:36 AM
Re: best local runtime for mixed models for Mixtral - by batchscope72 - 08-31-2026, 06:18 AM
|
Users browsing this thread: 1 Guest(s)