Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Jetson still a thing
#1
I'm trying to sanity-check my setup.

I'm mostly working with Mixtral in PyTorch on mini PC. The part I'm trying to understand is MoE serving.

If you've tested something similar, what did you keep and what did you stop bothering with?
Reply


Messages In This Thread
Jetson still a thing - by lablab - 10-17-2026, 01:33 AM
Re: Jetson still a thing - by homelabhenry - 10-17-2026, 03:07 AM
Re: Jetson still a thing - by localpatch - 10-17-2026, 03:41 PM
Re: Jetson still a thing - by vramghost - 10-17-2026, 07:45 PM
Re: Jetson still a thing - by batchfield55 - 10-17-2026, 09:20 PM
Re: Jetson still a thing - by thetatinker77 - 10-17-2026, 08:35 PM
Re: Jetson still a thing - by vramghost - 10-18-2026, 05:47 AM
Re: Jetson still a thing - by cobalttinker - 10-18-2026, 10:05 AM
Re: Jetson still a thing - by macrotinker - 10-19-2026, 03:35 AM
Re: Jetson still a thing - by homelabhenry - 10-18-2026, 11:49 AM
Re: Jetson still a thing - by oxiderunner - 10-18-2026, 11:41 PM
Re: Jetson still a thing - by thetatinker77 - 10-18-2026, 11:48 PM
Re: Jetson still a thing - by homelabhenry - 10-19-2026, 01:12 AM
Re: Jetson still a thing - by batchfield55 - 10-19-2026, 01:18 AM
Re: Jetson still a thing - by homelabhenry - 10-19-2026, 02:34 AM
Re: Jetson still a thing - by promptfield - 10-19-2026, 01:41 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)