Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
context stuffing mistakes on 7900 XTX
#5
Quote:[quote]I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.[/q

Thanks, that helps. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply


Messages In This Thread
Re: context stuffing mistakes on 7900 XTX - by bytesupply76 - 10-18-2026, 12:06 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)