+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: CPUs / NPUs / Accelerators (https://www.datasculpting.ai/inference/forumdisplay.php?fid=30)
+--- Thread: Any point in NPUs yet on dual 3090 (/showthread.php?tid=1094)
Pages:
1
2
Re: Any point in NPUs yet on dual 3090 - lablab - 10-18-2026
Quote:[quote]Appreciate the detail. The pattern around embeddings has been pretty similar for me. Worth rechecking your defaults though, because one bad ass
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: Any point in NPUs yet on dual 3090 - northquill - 10-18-2026
Did a small comparison this afternoon. On dual 3090 with TensorRT-LLM, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
Re: Any point in NPUs yet on dual 3090 - batchember - 10-18-2026
Good point. I don't think your conclusion is far off.
Re: Any point in NPUs yet on dual 3090 - cobaltworks25 - 10-19-2026
A couple questions before I guess too hard. Are you testing this on 4090 or something else?
Re: Any point in NPUs yet on dual 3090 - labnest - 10-19-2026
Appreciate the detail. The pattern around embeddings has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.