Inference
driver/framework news roundup - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26)
+--- Thread: driver/framework news roundup (/showthread.php?tid=817)

Pages: 1 2


Re: driver/framework news roundup - deepseeked - 10-13-2026

I tested this tonight. On 5090 with vLLM, I saw basically the same behavior.


Re: driver/framework news roundup - tensorriver - 10-13-2026

Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal.


Re: driver/framework news roundup - dockriver - 10-13-2026

What worked for me was pretty simple. On 7900 XTX, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.


Re: driver/framework news roundup - edgequill - 10-13-2026

What worked for me was pretty simple. If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.


Re: driver/framework news roundup - deepseeked - 10-13-2026

A couple questions before I guess too hard. What model, what runtime, and roughly what context size?