Inference › LLM Models › Proprietary / Frontier v
70B still worth the pain

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
70B still worth the pain
routecrate Offline
Member
***
Posts: 50
Threads: 4
Joined: Sep 2026
Reputation: 0
#3
10-18-2026, 09:38 PM
A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives.
Find
Reply


Messages In This Thread
70B still worth the pain - by turboscope - 10-19-2026, 12:02 AM
Re: 70B still worth the pain - by fastbench - 10-18-2026, 05:05 PM
Re: 70B still worth the pain - by routecrate - 10-18-2026, 09:38 PM
Re: 70B still worth the pain - by fastscope - 10-18-2026, 10:51 PM
Re: 70B still worth the pain - by ggufwire22 - 10-19-2026, 01:03 AM
Re: 70B still worth the pain - by mlxgarden - 10-19-2026, 01:32 AM
Re: 70B still worth the pain - by turboscope5 - 10-19-2026, 02:33 AM
Re: 70B still worth the pain - by batchsize - 10-19-2026, 02:09 AM
Re: 70B still worth the pain - by quietsupply11 - 10-19-2026, 03:10 AM
Re: 70B still worth the pain - by vramghost - 10-19-2026, 03:35 AM
Re: 70B still worth the pain - by tinycontext - 10-19-2026, 05:51 AM
Re: 70B still worth the pain - by amberkite - 10-18-2026, 09:16 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)