VRAM bottleneck on consumer cards for Qwen

[rocmriley]

[quote]My first guess would be this: Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. Not glamorous advic

Interesting, I hadn't tried that. I ended up in about the same place using LM Studio. The biggest change for me was simplifying the stack instead of adding one more optimization layer.