09-24-2026, 11:04 AM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
trying not to rebuild again
|
when video is still not worth the wait for DeepSeek
|
|
09-24-2026, 11:04 AM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher.
trying not to rebuild again
09-24-2026, 11:38 PM
What exact setup are you running? What model, what runtime, and roughly what context size?
09-25-2026, 12:03 PM
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
09-26-2026, 12:23 PM
My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings.
09-27-2026, 12:47 PM
Appreciate the detail. I ended up in about the same place using MLX.
|
|
« Next Oldest | Next Newest »
|