Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
context stuffing mistakes for Phi
#3
Good point. I ended up in about the same place using SGLang. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply


Messages In This Thread
context stuffing mistakes for Phi - by vrampilot - 10-05-2026, 05:02 AM
Re: context stuffing mistakes for Phi - by bytesupply76 - 10-05-2026, 02:39 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)