+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: 8B vs 14B sweet spot with TensorRT-LLM (/showthread.php?tid=1215)
8B vs 14B sweet spot with TensorRT-LLM - southspark - 10-15-2026
Posting this in case it saves someone else a little time.
I'm not trying to build a perfect architecture diagram. I just want a sane starting point around MLX and M3 Max.
Simple and boring is a valid answer.
Re: 8B vs 14B sweet spot with TensorRT-LLM - fastfield4 - 10-15-2026
A couple questions before I guess too hard. What model, what runtime, and roughly what context size?
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.