Inference
Embeddings discussion for FLUX - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Embeddings (https://www.datasculpting.ai/inference/forumdisplay.php?fid=59)
+--- Thread: Embeddings discussion for FLUX (/showthread.php?tid=1055)

Pages: 1 2


Re: Embeddings discussion for FLUX - vectorshed43 - 10-15-2026

That matches what I was seeing. That matches what I saw on mini PC. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.


Re: Embeddings discussion for FLUX - quantnest - 10-15-2026

Quote:That matches what I was seeing. That matches what I saw on mini PC. Worth rechecking your defaults though, because one bad assumption can make the res

I tested this tonight. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed.


Re: Embeddings discussion for FLUX - routerunner - 10-15-2026

Good point. I ended up in about the same place using Ollama. The biggest change for me was simplifying the stack instead of adding one more optimization layer.