Inference › LLM Models › Open Weight › Local v
recipes for a good local stack

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
recipes for a good local stack
rocmriley Offline
Member
***
Posts: 211
Threads: 21
Joined: Sep 2026
Reputation: 0
#7
10-04-2026, 04:07 AM
Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
7900 XTX / ROCm / somehow still optimistic
Find
Reply


Messages In This Thread
recipes for a good local stack - by rocmriley - 09-27-2026, 12:28 PM
Re: recipes for a good local stack - by mlxgarden - 09-27-2026, 05:08 PM
Re: recipes for a good local stack - by rocmriley - 10-07-2026, 01:47 PM
Re: recipes for a good local stack - by rocmriley - 09-27-2026, 07:27 PM
Re: recipes for a good local stack - by minthall - 09-27-2026, 07:40 PM
Re: recipes for a good local stack - by mintquill - 10-01-2026, 03:56 AM
Re: recipes for a good local stack - by rocmriley - 10-04-2026, 04:07 AM
Re: recipes for a good local stack - by rocmriley - 10-04-2026, 09:26 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)