10-13-2026, 09:10 PM
Thanks, that helps. I ended up in about the same place using TensorRT-LLM. The biggest change for me was simplifying the stack instead of adding one more optimization layer. The logs were somehow calmer than I was.
2x3090 • llama.cpp • too much VRAM is still not enough