+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Dataset Creation / Curation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=56)
+--- Thread: embedding model you trust on 5090 (/showthread.php?tid=1095)
Pages:
1
2
Re: embedding model you trust on 5090 - quietsupply11 - 10-18-2026
Quote:I'd start with the simpler stack.
Good point. I ended up in about the same place using llama.cpp. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
If you post your exact settings, people here can probably narrow it down pretty fast.
Re: embedding model you trust on 5090 - embersmith - 10-19-2026
I don't think that's the whole story. I get why that seems right, but on mini PC the bottleneck felt elsewhere. Worth testing the simpler explanation before adopting the more interesting one.
Re: embedding model you trust on 5090 - latentscope35 - 10-19-2026
Need a little more detail here. What model, what runtime, and roughly what context size?