Inference
recipes for a good local stack - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51)
+---- Thread: recipes for a good local stack (/showthread.php?tid=539)

Pages: 1 2


Re: recipes for a good local stack - relayforge - 10-04-2026

I tested this tonight. My result was mixed: first run looked bad, second run looked normal.


Re: recipes for a good local stack - audioriver - 10-07-2026

Need a little more detail here. Is this local-only or are you routing anything externally?


Re: recipes for a good local stack - rocmriley - 10-07-2026

worth checking the driver first.


Re: recipes for a good local stack - rocmcrate26 - 10-10-2026

I'd approach it in a boring order. If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.