+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Performance Tuning (https://www.datasculpting.ai/inference/forumdisplay.php?fid=42)
+--- Thread: consumer GPU serving economics (/showthread.php?tid=1342)
Pages:
1
2
Re: consumer GPU serving economics - stackarch - 10-18-2026
I hit almost the same issue last night.
Re: consumer GPU serving economics - tensorfield88 - 10-18-2026
Quote:I hit almost the same issue last night.
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal.
Re: consumer GPU serving economics - localpatch - 10-18-2026
I'd approach it in a boring order. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. Turns out 'just one more test' was a lie.