Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
long context that stayed useful
#3
That matches what I was seeing. The pattern around tokens/sec has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply


Messages In This Thread
long context that stayed useful - by cozywire - 08-25-2026, 02:31 PM
Re: long context that stayed useful - by sanescope - 08-26-2026, 07:00 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)