Inference
which hosted model is actually worth paying for - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: Workflows / Automation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=47)
+--- Thread: which hosted model is actually worth paying for (/showthread.php?tid=994)



which hosted model is actually worth paying for - routecraft - 10-10-2026

I figured I'd ask here before changing everything.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.

Would appreciate practical advice rather than theory.

This is mostly for local work rather than public serving.


Re: which hosted model is actually worth paying for - routecraft - 10-12-2026

I tested this tonight. On dual 3090 with Ollama, I saw basically the same behavior. The main thing that moved was latency, not quality.