09-09-2026, 05:11 PM
I think the bottleneck is somewhere else. I've seen people blame prefill/decode split when the real issue was much more mundane.
|
context stuffing mistakes: what are you seeing?
|
|
09-09-2026, 05:11 PM
I think the bottleneck is somewhere else. I've seen people blame prefill/decode split when the real issue was much more mundane.
09-09-2026, 05:19 PM
My first guess would be this: On 5090, the easiest win is often to back off the aggressive settings and see whether the problem survives.
curious and caffeinated
|
|
« Next Oldest | Next Newest »
|