+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: 7900 XTX local stack with Ollama (/showthread.php?tid=1112)
7900 XTX local stack with Ollama - thetaember38 - 10-13-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like continuous batching decides everything downstream.
Curious whether that lines up with what other people are seeing.