|
Threadripper build for inference: setup advice
|
08-22-2026, 10:01 PM
Thought I'd post a small recipe because a lot of threads ask similar things.
Maybe useful as a starting point: LM Studio on dual 3090, keeping prefill/decode split in mind from the start. Maybe useful as a starting point for newer folks.
rack in the garage • local models everywhere
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Threadripper build for inference: setup advice - by homelabhenry - 08-22-2026, 10:01 PM
Re: Threadripper build for inference: setup advice - by latentpeak22 - 08-23-2026, 02:16 AM
Re: Threadripper build for inference: setup advice - by batchwire - 08-23-2026, 04:48 AM
Re: Threadripper build for inference: setup advice - by phasenode - 08-24-2026, 04:58 PM
Re: Threadripper build for inference: setup advice - by vectorcrate98 - 08-24-2026, 06:41 PM
Re: Threadripper build for inference: setup advice - by labnest - 08-24-2026, 07:28 PM
Re: Threadripper build for inference: setup advice - by homelabhenry - 08-27-2026, 08:11 PM
Re: Threadripper build for inference: setup advice - by macroforge - 08-27-2026, 09:05 PM
|
