10-18-2026, 12:06 PM
Quote:[quote]I tested this tonight. On 5090 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.[/q
Thanks, that helps. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
