DeepSeek V4.1 impressions

[relayforge]

Appreciate the detail. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optimization

Can you fill in a bit more context? Is this local-only or are you routing anything externally?

[routecraft]

[quote]Appreciate the detail. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optim

I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.

[quantyard]

Tried to reproduce it just now. On 5090 with MLX, I saw basically the same behavior. I expected the model choice to matter more than it did.

[routecraft]

I hit almost the same issue last night.

[routecraft]

I'd start with the simpler stack.