08-26-2026, 09:39 AM
Curious what people here are seeing.
My current setup is SGLang with 7900 XTX, and I keep running into batch size.
Would appreciate practical advice rather than theory. The logs were somehow calmer than I was.
My current setup is SGLang with 7900 XTX, and I keep running into batch size.
Would appreciate practical advice rather than theory. The logs were somehow calmer than I was.
M3 Max • MLX • local-first