Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
when video is still not worth the wait for DeepSeek
#11
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
trying not to rebuild again
Reply
#12
What exact setup are you running? What model, what runtime, and roughly what context size?
Reply
#13
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
Reply
#14
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings.
Reply
#15
Appreciate the detail. I ended up in about the same place using MLX.
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)