Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
SBC inference experiments: early impressions
#14
What worked for me was pretty simple. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at workstation thermals.
small models can still be good
Reply


Messages In This Thread
Re: SBC inference experiments: early impressions - by quantsupply - 10-05-2026, 06:12 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)