Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
what music do you benchmark to with LM Studio
#1
This keeps coming up in conversation so I figured I'd start a thread.

It feels like the conversation has shifted hard toward inference and serving details lately, and honestly that makes sense once you start dealing with token cost.

Wondering if this is just where the whole space is heading now.
Reply
#2
Quote:This keeps coming up in conversation so I figured I'd start a thread.

That matches what I was seeing. The pattern around consumer GPUs has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
image models by night, local pipelines by day
Reply
#3
A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives.
curious and caffeinated
Reply
#4
that fixed it for me too.
Reply
#5
worth checking the driver first.
learning in public
Reply
#6
Interesting, I hadn't tried that. That matches what I saw on B200. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
small models can still be good
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)