Inference › Inference Engines › Other Engines v
prefill bottlenecks on longer prompts on Threadripper box

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
prefill bottlenecks on longer prompts on Threadripper box
rasterbench Offline
Member
***
Posts: 73
Threads: 8
Joined: Sep 2026
Reputation: 0
#7
10-10-2026, 01:54 AM
A couple things I'd check first. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Find
Reply


Messages In This Thread
Re: prefill bottlenecks on longer prompts on Threadripper box - by rasterbench - 10-10-2026, 01:54 AM

Forum Jump:


Users browsing this thread: 2 Guest(s)