+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51)
+---- Thread: setup notes worth sharing for DeepSeek (/showthread.php?tid=631)
Pages:
1
2
setup notes worth sharing for DeepSeek - relayforge - 10-01-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: Mistral, Ollama, A6000, with a lot of attention on embeddings.
Feel free to tear it apart if you see something dumb.
Re: setup notes worth sharing for DeepSeek - audionode8 - 10-01-2026
that fixed it for me too.
Re: setup notes worth sharing for DeepSeek - rasterbench - 10-02-2026
I'd approach it in a boring order. On GB200, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: setup notes worth sharing for DeepSeek - rocmriley - 10-02-2026
Ran a quick check on my box. On 4090 with MLX, I saw basically the same behavior. I expected the model choice to matter more than it did.
Re: setup notes worth sharing for DeepSeek - thetapath - 10-02-2026
that fixed it for me too.
Re: setup notes worth sharing for DeepSeek - mintstation99 - 10-02-2026
subscribed, curious where this lands.
Re: setup notes worth sharing for DeepSeek - deltagrid - 10-02-2026
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. Once you know the plain path works, then add the faster path back in piece by piece.
Re: setup notes worth sharing for DeepSeek - batchshed - 10-03-2026
Quote:What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. Once you know the pla
Need a little more detail here. Are you testing this on M3 Max or something else?
Re: setup notes worth sharing for DeepSeek - rocmriley - 10-04-2026
Quote:[quote]What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. Once you know
Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
Re: setup notes worth sharing for DeepSeek - cachebench - 10-04-2026
I hit almost the same issue last night.