+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Hosted (https://www.datasculpting.ai/inference/forumdisplay.php?fid=50)
+---- Thread: which local open model do you keep coming back to: what are you seeing? (/showthread.php?tid=292)
which local open model do you keep coming back to: what are you seeing? - promptfield - 09-16-2026
Did a bit of testing and thought I'd post the result here.
I tried this with Llama using SGLang on 7900 XTX. The headline result was better than I expected, but continuous batching still ended up being the limiting factor.
Curious if anyone else landed in the same place.