09-08-2026, 04:50 PM
Appreciate the detail. I ended up in about the same place using vLLM. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
|
Threadripper build for inference: worth it?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Threadripper build for inference: worth it? - by phasenode - 09-07-2026, 02:10 AM
Re: Threadripper build for inference: worth it? - by vrampilot - 09-07-2026, 10:46 AM
Re: Threadripper build for inference: worth it? - by edgequill - 09-09-2026, 08:24 PM
Re: Threadripper build for inference: worth it? - by vramscope - 09-07-2026, 11:47 AM
Re: Threadripper build for inference: worth it? - by phasenode - 09-07-2026, 04:21 PM
Re: Threadripper build for inference: worth it? - by vramghost - 09-08-2026, 04:50 PM
Re: Threadripper build for inference: worth it? - by vectorcrate98 - 09-08-2026, 05:39 PM
Re: Threadripper build for inference: worth it? - by labnest - 09-09-2026, 06:09 PM
Re: Threadripper build for inference: worth it? - by kernelhouse70 - 09-09-2026, 09:20 PM
|
Users browsing this thread: 1 Guest(s)