09-07-2026, 04:21 PM
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at quant drift.
|
Threadripper build for inference: worth it?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
Threadripper build for inference: worth it? - by phasenode - 09-07-2026, 02:10 AM
Re: Threadripper build for inference: worth it? - by vrampilot - 09-07-2026, 10:46 AM
Re: Threadripper build for inference: worth it? - by edgequill - 09-09-2026, 08:24 PM
Re: Threadripper build for inference: worth it? - by vramscope - 09-07-2026, 11:47 AM
Re: Threadripper build for inference: worth it? - by phasenode - 09-07-2026, 04:21 PM
Re: Threadripper build for inference: worth it? - by vramghost - 09-08-2026, 04:50 PM
Re: Threadripper build for inference: worth it? - by vectorcrate98 - 09-08-2026, 05:39 PM
Re: Threadripper build for inference: worth it? - by labnest - 09-09-2026, 06:09 PM
Re: Threadripper build for inference: worth it? - by kernelhouse70 - 09-09-2026, 09:20 PM
|
Users browsing this thread: 1 Guest(s)