09-21-2026, 12:02 PM
What exact setup are you running? Are you testing this on mini PC or something else?
|
RTX 5090 local inference on mini PC
|
|
09-21-2026, 12:02 PM
What exact setup are you running? Are you testing this on mini PC or something else?
09-21-2026, 01:53 PM
Quote:What exact setup are you running? Are you testing this on mini PC or something else? My first guess would be this: On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
M3 Max • MLX • local-first
09-23-2026, 02:36 AM
That matches what I was seeing. I ended up in about the same place using Ollama. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
|
|
« Next Oldest | Next Newest »
|