![]() |
|
70B still worth the pain - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12) +--- Forum: Proprietary / Frontier (https://www.datasculpting.ai/inference/forumdisplay.php?fid=48) +--- Thread: 70B still worth the pain (/showthread.php?tid=564) |
70B still worth the pain - circuitworks90 - 09-28-2026 Posting this in case it saves someone else a little time. I'm not trying to build a perfect architecture diagram. I just want a sane starting point around LM Studio and Threadripper box. Would rather learn from your scars than collect my own all at once. |