Inference
clean API wrappers for local agents - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Embedding / Reranking Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=53)
+--- Thread: clean API wrappers for local agents (/showthread.php?tid=894)



clean API wrappers for local agents - flintriver50 - 10-09-2026

Did a bit of testing and thought I'd post the result here.

Short version: Ollama behaved well for me, but only after I stopped ignoring small local stacks.

Happy to post more details if anyone wants them.