+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Prompting & Context Engineering (https://www.datasculpting.ai/inference/forumdisplay.php?fid=15)
+--- Forum: Prompts / System Prompts (https://www.datasculpting.ai/inference/forumdisplay.php?fid=62)
+--- Thread: system prompt habits that helped for Mixtral (/showthread.php?tid=933)
Pages:
1
2
Re: system prompt habits that helped for Mixtral - quiettoken - 10-13-2026
Thanks, that helps. I don't think your conclusion is far off. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
Re: system prompt habits that helped for Mixtral - thetaarch43 - 10-13-2026
Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?
Re: system prompt habits that helped for Mixtral - cudapeak - 10-13-2026
Quote:Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?
Interesting, I hadn't tried that. That matches what I saw on 4090.
Re: system prompt habits that helped for Mixtral - thetafield - 10-14-2026
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed. At this point the real bottleneck is my patience.