Inference › LLM Models › Open Weight › Local v
recipes for a good local stack

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
recipes for a good local stack
mlxgarden Offline
Member
***
Posts: 199
Threads: 27
Joined: Sep 2026
Reputation: 0
#1
10-14-2026, 11:41 PM
Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: TensorRT-LLM on 7900 XTX, keeping structured output in mind from the start.

Feel free to tear it apart if you see something dumb.
M3 Max • MLX • local-first
Find
Reply


Messages In This Thread
recipes for a good local stack - by mlxgarden - 10-14-2026, 11:41 PM
Re: recipes for a good local stack - by deltagrid - 10-16-2026, 12:16 AM
Re: recipes for a good local stack - by rocmriley - 10-15-2026, 08:39 AM
Re: recipes for a good local stack - by llmpeak - 10-16-2026, 02:06 AM
Re: recipes for a good local stack - by rocmriley - 10-16-2026, 06:20 AM
Re: recipes for a good local stack - by mlxgarden - 10-18-2026, 09:06 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)