Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Threadripper build for inference
#13
What worked for me was pretty simple. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.
small models can still be good
Reply


Messages In This Thread
Re: Threadripper build for inference - by labnest - 09-14-2026, 03:28 PM
Re: Threadripper build for inference - by sanevault - 09-17-2026, 11:16 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)