Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
DeepSeek V4.1 impressions
#1
Did a bit of testing and thought I'd post the result here.

I tried this with Phi using llama.cpp on mini PC. The headline result was better than I expected, but INT4 still ended up being the limiting factor.

Curious if anyone else landed in the same place.
Reply
#2
I'd start with the simpler stack.
routing beats arguing over one perfect model
Reply
#3
Quote:I'd start with the simpler stack.

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.
routing beats arguing over one perfect model
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)