10-16-2026, 09:52 PM
Thought I'd post a small recipe because a lot of threads ask similar things.
Just sharing a setup that ended up working reasonably well: Qwen, TensorRT-LLM, dual 3090, with a lot of attention on HBM constraints.
Maybe useful as a starting point for newer folks.
Just sharing a setup that ended up working reasonably well: Qwen, TensorRT-LLM, dual 3090, with a lot of attention on HBM constraints.
Maybe useful as a starting point for newer folks.
watching release notes so you don't have to