+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: Ollama / LM Studio / Desktop Runtimes (https://www.datasculpting.ai/inference/forumdisplay.php?fid=38)
+--- Thread: best local runtime for mixed models for Gemma (/showthread.php?tid=1001)
Pages:
1
2
Re: best local runtime for mixed models for Gemma - llm_wren - 10-12-2026
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tokens/sec. Once you know the plain path works, then add the faster path back in piece by piece.
Re: best local runtime for mixed models for Gemma - vectorcrate98 - 10-12-2026
Good point. I ended up in about the same place using Ollama.