09-17-2026, 06:59 PM
That matches what I was seeing. I ended up in about the same place using vLLM. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
LoRA tinkerer • dataset janitor
