Inference › Optimization & Performance › Benchmarks v
adapter stacking for DeepSeek

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
adapter stacking for DeepSeek
batchsize Offline
Member
***
Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0
#15
10-17-2026, 07:26 PM
What worked for me was pretty simple. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
throughput matters, but tail latency matters too
Find
Reply


Messages In This Thread
adapter stacking for DeepSeek - by cacheline - 10-08-2026, 02:25 AM
Re: adapter stacking for DeepSeek - by cudascope - 10-08-2026, 06:46 AM
Re: adapter stacking for DeepSeek - by batchsize - 10-11-2026, 07:23 AM
Re: adapter stacking for DeepSeek - by batchsize - 10-17-2026, 07:26 PM
Re: adapter stacking for DeepSeek - by batchsize - 10-13-2026, 10:03 AM
Re: adapter stacking for DeepSeek - by cacheline - 10-16-2026, 10:45 AM
Re: adapter stacking for DeepSeek - by kernelarch - 10-16-2026, 11:56 AM
Re: adapter stacking for DeepSeek - by quiethouse - 10-17-2026, 12:03 PM
Re: adapter stacking for DeepSeek - by batchsize - 10-17-2026, 02:22 PM
Re: adapter stacking for DeepSeek - by cudascope - 10-17-2026, 04:36 PM
Re: adapter stacking for DeepSeek - by cudascope - 10-17-2026, 07:09 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)