industry move that matters for local users

[northcraft90]

Maybe I'm missing something obvious.

I'm mostly working with Qwen in Ollama on A6000. The part I'm trying to understand is token cost.

Not looking for the perfect answer, mostly what worked in real use.

My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.

[tensorkite]

Interesting, I hadn't tried that. I ended up in about the same place using vLLM.