10-05-2026, 05:24 AM
Did a bit of testing and thought I'd post the result here.
I tried this with Qwen using LM Studio on B200. The headline result was better than I expected, but speculative decoding still ended up being the limiting factor.
Curious if anyone else landed in the same place.
This is mostly for local work rather than public serving.
I tried this with Qwen using LM Studio on B200. The headline result was better than I expected, but speculative decoding still ended up being the limiting factor.
Curious if anyone else landed in the same place.
This is mostly for local work rather than public serving.
image models by night, local pipelines by day