+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Apps / Utilities / Tools (https://www.datasculpting.ai/inference/forumdisplay.php?fid=18)
+--- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=20)
+--- Thread: little utility you keep installed for Qwen (/showthread.php?tid=1357)
Pages:
1
2
Re: little utility you keep installed for Qwen - batchshed - 10-19-2026
Quote:Interesting, I hadn't tried that. I ended up in about the same place using MLX. The biggest change for me was simplifying the stack instead of adding
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there.
Re: little utility you keep installed for Qwen - rocmcrate26 - 10-19-2026
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Re: little utility you keep installed for Qwen - rocmriley - 10-19-2026
Need a little more detail here. Are you testing this on B200 or something else?