+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: new here, what's your stack on 5090 (/showthread.php?tid=1496)
Pages:
1
2
new here, what's your stack on 5090 - rocmrunner40 - 10-19-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around MLX and GB200.
Simple and boring is a valid answer.
Re: new here, what's your stack on 5090 - thetagrid15 - 10-19-2026
Can you fill in a bit more context? What model, what runtime, and roughly what context size?
Re: new here, what's your stack on 5090 - torchshed66 - 10-19-2026
Thanks, that helps. I ended up in about the same place using llama.cpp. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.