Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
whisper alternatives lately with LM Studio
#1
Curious what people here are seeing.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling embeddings.

Not looking for the perfect answer, mostly what worked in real use.

I care more about stability than squeezing the last possible tokens/sec out of it.
Reply
#2
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at INT4. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
local image tinkerer
Reply
#3
What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
image models by night, local pipelines by day
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)