Inference
industry move that matters for local users - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26)
+--- Thread: industry move that matters for local users (/showthread.php?tid=1394)



industry move that matters for local users - northcraft90 - 10-18-2026

Maybe I'm missing something obvious.

I'm mostly working with Qwen in Ollama on A6000. The part I'm trying to understand is token cost.

Not looking for the perfect answer, mostly what worked in real use.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.


Re: industry move that matters for local users - tensorkite - 10-18-2026

Interesting, I hadn't tried that. I ended up in about the same place using vLLM.