09-23-2026, 11:51 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between LM Studio and vLLM for DeepSeek. The interesting difference for me has been HBM constraints.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it. I keep promising myself this is the last rebuild.
I've gone back and forth between LM Studio and vLLM for DeepSeek. The interesting difference for me has been HBM constraints.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it. I keep promising myself this is the last rebuild.