Inference
70B still worth the pain - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48)
+--- Thread: 70B still worth the pain (/showthread.php?tid=165)

Pages: 1 2


Re: 70B still worth the pain - torchsmith25 - 09-16-2026

same here on my side.


Re: 70B still worth the pain - relayforge - 09-16-2026

I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Mixtral and compare from there.


Re: 70B still worth the pain - amberrunner - 09-16-2026

I'd start with the simpler stack.

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.


Re: 70B still worth the pain - localtinker - 09-17-2026

following this because I'm in the same boat.