Inference › LLM Models › Proprietary / Frontier v
70B still worth the pain

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
70B still worth the pain
routeline23 Offline
Junior Member
**
Posts: 46
Threads: 7
Joined: Sep 2026
Reputation: 0
#11
10-08-2026, 04:44 AM
Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.

If you post your exact settings, people here can probably narrow it down pretty fast.
Find
Reply


Messages In This Thread
70B still worth the pain - by cobaltworks25 - 10-06-2026, 05:33 PM
Re: 70B still worth the pain - by sanevault - 10-06-2026, 07:39 PM
Re: 70B still worth the pain - by latentscope35 - 10-06-2026, 08:51 PM
Re: 70B still worth the pain - by kernelghost - 10-06-2026, 09:28 PM
Re: 70B still worth the pain - by cacheline - 10-08-2026, 12:33 AM
Re: 70B still worth the pain - by plaingarden18 - 10-08-2026, 05:19 PM
Re: 70B still worth the pain - by phasetrack - 10-06-2026, 11:58 PM
Re: 70B still worth the pain - by mellowstream - 10-07-2026, 12:05 PM
Re: 70B still worth the pain - by tensorriver - 10-08-2026, 12:58 AM
Re: 70B still worth the pain - by macronest - 10-08-2026, 03:15 AM
Re: 70B still worth the pain - by macrolab - 10-08-2026, 03:42 AM
Re: 70B still worth the pain - by routeline23 - 10-08-2026, 04:44 AM
Re: 70B still worth the pain - by edgekite - 10-08-2026, 05:07 PM
Re: 70B still worth the pain - by deltastation - 10-11-2026, 05:46 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)