10-02-2026, 10:29 AM
Quote:worth checking the driver first.
I tested this tonight. On Threadripper box with TensorRT-LLM, I saw basically the same behavior. The main thing that moved was latency, not quality.
context windows are not a product strategy
