09-28-2026, 03:06 AM
Thanks, that helps. I ended up in about the same place using vLLM. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
curious and caffeinated
|
best mini PC for local use on 7900 XTX
|
|
« Next Oldest | Next Newest »
|