+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: GPUs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=28)
+--- Thread: RTX 5090 local inference: early impressions (/showthread.php?tid=1275)
RTX 5090 local inference: early impressions - phasenode - 10-15-2026
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: DeepSeek, llama.cpp, A6000, with a lot of attention on consumer GPUs.
If someone wants the exact settings I can clean them up and post them.
Re: RTX 5090 local inference: early impressions - rocmriley - 10-15-2026
Quote:Thought I'd post a small recipe because a lot of threads ask similar things.
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
Re: RTX 5090 local inference: early impressions - signaltrack44 - 10-15-2026
following this because I'm in the same boat.
Re: RTX 5090 local inference: early impressions - vrambandit - 10-15-2026
A couple things I'd check first. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: RTX 5090 local inference: early impressions - fusedhall - 10-15-2026
Can you fill in a bit more context? Is this local-only or are you routing anything externally?
Re: RTX 5090 local inference: early impressions - bytelab - 10-15-2026
A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.
Re: RTX 5090 local inference: early impressions - batchember - 10-16-2026
Quote:A couple things I'd check first. If you're on LM Studio, I'd confirm the version first and then reduce variables until the behavior is obvious. Not gl
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Qwen and compare from there.