09-24-2026, 05:26 AM
Thought I'd post a small recipe because a lot of threads ask similar things.
Maybe useful as a starting point: Ollama on M3 Max, keeping reranking in mind from the start.
Feel free to tear it apart if you see something dumb.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
I expected the biggest difference to come from the model, but the stack around it mattered at least as much.
Maybe useful as a starting point: Ollama on M3 Max, keeping reranking in mind from the start.
Feel free to tear it apart if you see something dumb.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
I expected the biggest difference to come from the model, but the stack around it mattered at least as much.