08-31-2026, 01:30 AM
Thanks, that helps. I ended up in about the same place using SGLang. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
|
best setup on 24GB VRAM for Phi
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
best setup on 24GB VRAM for Phi - by sparrowkite53 - 08-28-2026, 08:06 AM
Re: best setup on 24GB VRAM for Phi - by thetashed24 - 08-28-2026, 10:51 AM
Re: best setup on 24GB VRAM for Phi - by tensorriver - 08-29-2026, 11:37 AM
Re: best setup on 24GB VRAM for Phi - by torchsmith25 - 08-29-2026, 12:11 PM
Re: best setup on 24GB VRAM for Phi - by sparrowshed - 08-29-2026, 12:42 PM
Re: best setup on 24GB VRAM for Phi - by modbench - 08-29-2026, 12:58 PM
Re: best setup on 24GB VRAM for Phi - by vectorfield - 08-31-2026, 01:30 AM
Re: best setup on 24GB VRAM for Phi - by thetarunner - 08-31-2026, 10:16 AM
|
Users browsing this thread: 1 Guest(s)