Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
simple local serving recipe on 5090
#1
Curious what people here are seeing.

I'm mostly working with Phi in PyTorch on mini PC. The part I'm trying to understand is HBM constraints.

Not looking for the perfect answer, mostly what worked in real use.
7900 XTX / ROCm / somehow still optimistic
Reply


Messages In This Thread
simple local serving recipe on 5090 - by rocmriley - 09-23-2026, 06:01 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)