10-18-2026, 09:22 AM
Quote:I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at small local stacks. Once you know the plain path works, then add the faster path back in piece by piece.
