+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: News & Industry (https://www.datasculpting.ai/inference/forumdisplay.php?fid=26)
+--- Thread: latest release actually worth attention with SGLang (/showthread.php?tid=209)
latest release actually worth attention with SGLang - cozyarch - 09-09-2026
Spent some time on this today and wanted to compare notes.
Two paths both seem viable, but they break down differently once batch size becomes important.
What would you pick if you had to live with it for a few months?