10-14-2026, 02:38 PM
I figured I'd ask here before changing everything.
I'm mostly working with Mistral in Ollama on 4090. The part I'm trying to understand is prefill/decode split.
If you've tested something similar, what did you keep and what did you stop bothering with?
I'm mostly working with Mistral in Ollama on 4090. The part I'm trying to understand is prefill/decode split.
If you've tested something similar, what did you keep and what did you stop bothering with?