Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
best mini PC for local use with vLLM
#9
A couple things I'd check first. On Threadripper box, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time. At this point the real bottleneck is my patience.
rack in the garage • local models everywhere
Reply


Messages In This Thread
Re: best mini PC for local use with vLLM - by homelabhenry - 10-18-2026, 07:09 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)