+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Embedding / Reranking Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=53)
+--- Thread: clean API wrappers for local agents (/showthread.php?tid=155)
Pages:
1
2
Re: clean API wrappers for local agents - rocmstack25 - 09-11-2026
Not sure I agree there. I've seen people blame MoE serving when the real issue was much more mundane.
Re: clean API wrappers for local agents - mangopeak72 - 09-11-2026
Quote:Not sure I agree there. I've seen people blame MoE serving when the real issue was much more mundane.
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there.
Re: clean API wrappers for local agents - fastbench - 09-13-2026
Quote:Quote:Not sure I agree there. I've seen people blame MoE serving when the real issue was much more mundane.
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at embeddings. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.