![]() |
|
simple router policy ideas: worth it? - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12) +--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49) +---- Forum: Recipes & Configurations (https://www.datasculpting.ai/inference/forumdisplay.php?fid=52) +---- Thread: simple router policy ideas: worth it? (/showthread.php?tid=170) |
simple router policy ideas: worth it? - turbogrid11 - 09-07-2026 Posting this in case it saves someone else a little time. I'm not trying to build a perfect architecture diagram. I just want a sane starting point around SGLang and mini PC. Simple and boring is a valid answer. The logs were somehow calmer than I was. Re: simple router policy ideas: worth it? - fusedriver - 09-07-2026 I don't think that's the whole story. I've seen people blame small local stacks when the real issue was much more mundane. |