![]() |
|
RTX 5090 local inference on mini PC - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4) +--- Forum: GPUs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=28) +--- Thread: RTX 5090 local inference on mini PC (/showthread.php?tid=307) Pages:
1
2
|
Re: RTX 5090 local inference on mini PC - signaltrack44 - 09-21-2026 What exact setup are you running? Are you testing this on mini PC or something else? Re: RTX 5090 local inference on mini PC - mlxgarden - 09-21-2026 Quote:What exact setup are you running? Are you testing this on mini PC or something else? My first guess would be this: On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives. Re: RTX 5090 local inference on mini PC - turboyard94 - 09-23-2026 That matches what I was seeing. I ended up in about the same place using Ollama. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing. |