Inference › LLM Models › Open Weight › Hosted
best setup on 24GB VRAM for Phi

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
best setup on 24GB VRAM for Phi
thetashed24 Offline
Member
***
Posts: 59
Threads: 7
Joined: Oct 2026
Reputation: 0
#2
08-28-2026, 10:51 AM
A couple things I'd check first. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
learning in public
Find
Reply


Messages In This Thread
Re: best setup on 24GB VRAM for Phi - by thetashed24 - 08-28-2026, 10:51 AM
Re: best setup on 24GB VRAM for Phi - by modbench - 08-29-2026, 12:58 PM

Forum Jump:


Users browsing this thread: 2 Guest(s)