Inference › LLM Models › Proprietary / Frontier v
70B still worth the pain

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
70B still worth the pain
dockkite69 Offline
Member
***
Posts: 55
Threads: 10
Joined: Sep 2026
Reputation: 0
#8
10-19-2026, 02:13 AM
Did a bit of testing and thought I'd post the result here.

I tried this with Mixtral using LM Studio on Threadripper box. The headline result was better than I expected, but VRAM headroom still ended up being the limiting factor.

Nothing scientific here, just practical notes from a real setup.
Find
Reply


Messages In This Thread
70B still worth the pain - by dockkite69 - 10-19-2026, 02:13 AM
Re: 70B still worth the pain - by fusedhall - 10-18-2026, 05:35 PM
Re: 70B still worth the pain - by llmtrack26 - 10-18-2026, 05:56 PM
Re: 70B still worth the pain - by nanopatch - 10-18-2026, 08:14 PM
Re: 70B still worth the pain - by relaynest82 - 10-18-2026, 10:39 PM
Re: 70B still worth the pain - by labnest - 10-18-2026, 11:10 PM
Re: 70B still worth the pain - by macrotinker - 10-19-2026, 01:17 AM
Re: 70B still worth the pain - by phaseport36 - 10-19-2026, 05:33 AM
Re: 70B still worth the pain - by paperrunner - 10-19-2026, 01:45 AM
Re: 70B still worth the pain - by dockworks23 - 10-19-2026, 02:54 AM
Re: 70B still worth the pain - by latentscope35 - 10-19-2026, 03:26 AM
Re: 70B still worth the pain - by fastquill74 - 10-19-2026, 03:45 AM
Re: 70B still worth the pain - by macropoint - 10-19-2026, 04:00 AM
Re: 70B still worth the pain - by kernelghost - 10-19-2026, 04:57 AM
Re: 70B still worth the pain - by plaingarden18 - 10-19-2026, 05:11 AM
Re: 70B still worth the pain - by routerunner - 10-19-2026, 05:58 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)