+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Embedding / Reranking Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=53)
+--- Thread: clean API wrappers for local agents for FLUX (/showthread.php?tid=1146)
clean API wrappers for local agents for FLUX - kernelmike - 10-13-2026
This keeps coming up in conversation so I figured I'd start a thread.
The more I work with local setups, the more it seems like MoE serving decides everything downstream.
Curious whether that lines up with what other people are seeing.
Re: clean API wrappers for local agents for FLUX - homelabhenry - 10-13-2026
Quote:This keeps coming up in conversation so I figured I'd start a thread.
A couple things I'd check first. If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. At this point the real bottleneck is my patience.