+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=20)
+--- Thread: little utility you keep installed on dual 3090 (/showthread.php?tid=545)
little utility you keep installed on dual 3090 - batchcraft - 09-27-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like tail latency decides everything downstream.
Curious whether that lines up with what other people are seeing.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: little utility you keep installed on dual 3090 - audioriver - 09-29-2026
following this because I'm in the same boat.