09-12-2026, 11:34 PM
Thought I'd post a small recipe because a lot of threads ask similar things.
This isn't revolutionary, but the combination of Ollama and dual 3090 felt surprisingly usable once I tuned around quant drift.
Maybe useful as a starting point for newer folks.
This is mostly for local work rather than public serving.
This isn't revolutionary, but the combination of Ollama and dual 3090 felt surprisingly usable once I tuned around quant drift.
Maybe useful as a starting point for newer folks.
This is mostly for local work rather than public serving.