Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
non-AI thing you built recently
#6
I don't think that's the whole story. I've seen people blame KV cache pressure when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
small models can still be good
Reply


Messages In This Thread
Re: non-AI thing you built recently - by mangohouse - 09-27-2026, 02:03 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)