+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: Off Topic (https://www.datasculpting.ai/inference/forumdisplay.php?fid=27)
+--- Thread: desk setup thread for Gemma (/showthread.php?tid=702)
Pages:
1
2
Re: desk setup thread for Gemma - dockbrook21 - 10-08-2026
Need a little more detail here. What model, what runtime, and roughly what context size?
Re: desk setup thread for Gemma - localpatch - 10-08-2026
My first guess would be this: On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Re: desk setup thread for Gemma - labline - 10-08-2026
What exact setup are you running? What model, what runtime, and roughly what context size?
Re: desk setup thread for Gemma - mangohouse - 10-08-2026
What worked for me was pretty simple. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. The logs were somehow calmer than I was.