+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Embeddings (https://www.datasculpting.ai/inference/forumdisplay.php?fid=59)
+--- Thread: Embeddings discussion (/showthread.php?tid=830)
Pages:
1
2
Re: Embeddings discussion - ggufwire22 - 10-11-2026
Interesting, I hadn't tried that. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: Embeddings discussion - edgecoast - 10-11-2026
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
Re: Embeddings discussion - vramscope - 10-14-2026
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?