Inference
7900 XTX local stack - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Drivers / Frameworks / Toolkits (https://www.datasculpting.ai/inference/forumdisplay.php?fid=8)
+--- Forum: AMD / ROCm (https://www.datasculpting.ai/inference/forumdisplay.php?fid=32)
+--- Thread: 7900 XTX local stack (/showthread.php?tid=1077)



7900 XTX local stack - rocmmixer - 10-11-2026

Wanted to compare notes with people doing similar things.

I'm mostly working with Mistral in MLX on mini PC. The part I'm trying to understand is tokens/sec.

Not looking for the perfect answer, mostly what worked in real use.

I care more about stability than squeezing the last possible tokens/sec out of it.