+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Edge AI & Gadgets (https://www.datasculpting.ai/inference/forumdisplay.php?fid=21)
+--- Forum: AI Devices (https://www.datasculpting.ai/inference/forumdisplay.php?fid=75)
+--- Thread: dedicated AI gadgets you actually use (/showthread.php?tid=178)
Pages:
1
2
Re: dedicated AI gadgets you actually use - lablab - 09-10-2026
worth checking the driver first.
Re: dedicated AI gadgets you actually use - rocmpath - 09-10-2026
Can you fill in a bit more context? Are you testing this on Threadripper box or something else?
Re: dedicated AI gadgets you actually use - mangopath4 - 09-11-2026
That matches what I was seeing. I ended up in about the same place using Ollama. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: dedicated AI gadgets you actually use - plainworks - 09-11-2026
What worked for me was pretty simple. On dual 3090, the easiest win is often to back off the aggressive settings and see whether the problem survives.