+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: 70B still worth the pain (/showthread.php?tid=1461)
Pages:
1
2
Re: 70B still worth the pain - vramghost - 10-19-2026
Did a small comparison this afternoon. On 5090 with MLX, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
Re: 70B still worth the pain - tinycontext - 10-19-2026
that fixed it for me too.