+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: what are you all running this week for Mixtral (/showthread.php?tid=1131)
Pages:
1
2
Re: what are you all running this week for Mixtral - rocmrunner40 - 10-15-2026
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.
Re: what are you all running this week for Mixtral - cacheplane98 - 10-16-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.