|
M3 Max for local use for Mixtral
|
10-01-2026, 06:32 AM
Ran a quick check on my box. On dual 3090 with SGLang, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
If you post your exact settings, people here can probably narrow it down pretty fast.
Apple Silicon • MLX mostly
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
M3 Max for local use for Mixtral - by visionyard23 - 10-01-2026, 12:58 AM
Re: M3 Max for local use for Mixtral - by quietarch - 10-01-2026, 02:19 AM
Re: M3 Max for local use for Mixtral - by turboyard94 - 10-01-2026, 03:35 AM
Re: M3 Max for local use for Mixtral - by dockriver - 10-01-2026, 05:44 AM
Re: M3 Max for local use for Mixtral - by visionyard23 - 10-01-2026, 06:32 AM
Re: M3 Max for local use for Mixtral - by labnest - 10-02-2026, 07:12 AM
|
