+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Security, Privacy & Safety (https://www.datasculpting.ai/inference/forumdisplay.php?fid=23)
+--- Forum: Local Privacy (https://www.datasculpting.ai/inference/forumdisplay.php?fid=76)
+--- Thread: private docs and local pipelines on 5090 (/showthread.php?tid=1251)
private docs and local pipelines on 5090 - ggufwire22 - 10-14-2026
Did a bit of testing and thought I'd post the result here.
I tried this with Mistral using LM Studio on GB200. The headline result was better than I expected, but token cost still ended up being the limiting factor.
Curious if anyone else landed in the same place.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.