+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Optimization & Performance (https://www.datasculpting.ai/inference/forumdisplay.php?fid=10)
+--- Forum: Benchmarks (https://www.datasculpting.ai/inference/forumdisplay.php?fid=43)
+--- Thread: adapter stacking (/showthread.php?tid=1059)
Pages:
1
2
adapter stacking - torchsmith25 - 10-12-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around TensorRT-LLM and A6000.
Simple and boring is a valid answer.
Re: adapter stacking - northgrid33 - 10-12-2026
subscribed, curious where this lands.
Re: adapter stacking - batchpeak - 10-12-2026
worth checking the driver first.
Re: adapter stacking - deltastation - 10-12-2026
same here on my side.
Re: adapter stacking - localtinker - 10-12-2026
Quote:same here on my side.
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
Re: adapter stacking - benchplease - 10-12-2026
A couple things I'd check first. On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Re: adapter stacking - quietsupply11 - 10-12-2026
That matches what I was seeing. That matches what I saw on Threadripper box. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: adapter stacking - deltastation - 10-12-2026
same here on my side.
Re: adapter stacking - tensorport - 10-13-2026
Need a little more detail here. Do you see the same thing with a smaller batch or shorter prompt?
Re: adapter stacking - cacheline - 10-13-2026
That matches what I was seeing. That matches what I saw on 4090. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.