Inference
driver/framework news roundup with Ollama - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26)
+--- Thread: driver/framework news roundup with Ollama (/showthread.php?tid=1163)

Pages: 1 2


Re: driver/framework news roundup with Ollama - phaseshed - 10-18-2026

Quote:A couple things I'd check first. On 4090, the easiest win is often to back off the aggressive settings and see whether the problem survives.

Maybe, but I had the opposite result. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.


Re: driver/framework news roundup with Ollama - dockriver - 10-18-2026

My first guess would be this: Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tool calling. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. Turns out 'just one more test' was a lie.


Re: driver/framework news roundup with Ollama - southpatch - 10-19-2026

A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.


Re: driver/framework news roundup with Ollama - deepseeked - 10-19-2026

Interesting, I hadn't tried that. I don't think your conclusion is far off.