+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Recipes & Configurations (https://www.datasculpting.ai/inference/forumdisplay.php?fid=52)
+---- Thread: model fallback rules that work with Ollama (/showthread.php?tid=537)
model fallback rules that work with Ollama - torchdesk - 09-28-2026
Curious what people here are seeing.
I'm mostly working with Gemma in PyTorch on 7900 XTX. The part I'm trying to understand is quant drift.
Not looking for the perfect answer, mostly what worked in real use.