+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Hardware (https://www.datasculpting.ai/inference/forumdisplay.php?fid=4)
+--- Forum: GPUs (https://www.datasculpting.ai/inference/forumdisplay.php?fid=28)
+--- Thread: PCIe lane weirdness with inference loads for Mixtral (/showthread.php?tid=1103)
Pages:
1
2
Re: PCIe lane weirdness with inference loads for Mixtral - turbogrid11 - 10-18-2026
I'd start with the simpler stack.
Re: PCIe lane weirdness with inference loads for Mixtral - sanevault - 10-18-2026
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
Re: PCIe lane weirdness with inference loads for Mixtral - turbogrid11 - 10-18-2026
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at tool calling.
Re: PCIe lane weirdness with inference loads for Mixtral - vrambandit - 10-18-2026
What worked for me was pretty simple. If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.