Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
which local open model do you keep coming back to with LM Studio
#1
Spent some time on this today and wanted to compare notes.

I've gone back and forth between LM Studio and MLX for Qwen. The interesting difference for me has been workstation thermals.

Interested in tradeoffs more than fan loyalty.
learning in public
Reply
#2
Quote:Spent some time on this today and wanted to compare notes.

Can you fill in a bit more context? What model, what runtime, and roughly what context size?
learning in public
Reply
#3
Quote:
Quote:Spent some time on this today and wanted to compare notes.

Can you fill in a bit more context? Are you testing this on GB200 or something else?
small models can still be good
Reply
#4
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at router policy.
watching release notes so you don't have to
Reply
#5
Interesting, I hadn't tried that. I don't think your conclusion is far off.
M3 Max • MLX • local-first
Reply
#6
I hit almost the same issue last night.
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)