![]() |
|
recipes for a good local stack - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12) +--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49) +---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51) +---- Thread: recipes for a good local stack (/showthread.php?tid=539) Pages:
1
2
|
Re: recipes for a good local stack - relayforge - 10-04-2026 I tested this tonight. My result was mixed: first run looked bad, second run looked normal. Re: recipes for a good local stack - audioriver - 10-07-2026 Need a little more detail here. Is this local-only or are you routing anything externally? Re: recipes for a good local stack - rocmriley - 10-07-2026 worth checking the driver first. Re: recipes for a good local stack - rocmcrate26 - 10-10-2026 I'd approach it in a boring order. If you're on SGLang, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time. |