+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Inference Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=9)
+--- Forum: Other Engines (https://www.datasculpting.ai/inference/forumdisplay.php?fid=39)
+--- Thread: throughput per watt reality check with Ollama (/showthread.php?tid=573)
throughput per watt reality check with Ollama - macropilot - 09-30-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
Simple and boring is a valid answer.
Re: throughput per watt reality check with Ollama - griffinloom66 - 09-30-2026
My first guess would be this: If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.
Re: throughput per watt reality check with Ollama - deltapoint17 - 09-30-2026
I think the bottleneck is somewhere else. I've seen people blame quant drift when the real issue was much more mundane.