![]() |
|
which hosted model is actually worth paying for - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11) +--- Forum: Workflows / Automation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=47) +--- Thread: which hosted model is actually worth paying for (/showthread.php?tid=994) |
which hosted model is actually worth paying for - routecraft - 10-10-2026 I figured I'd ask here before changing everything. I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec. Would appreciate practical advice rather than theory. This is mostly for local work rather than public serving. Re: which hosted model is actually worth paying for - routecraft - 10-12-2026 I tested this tonight. On dual 3090 with Ollama, I saw basically the same behavior. The main thing that moved was latency, not quality. |