+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Embeddings (https://www.datasculpting.ai/inference/forumdisplay.php?fid=59)
+--- Thread: Help with Embeddings (/showthread.php?tid=738)
Help with Embeddings - rasterhall - 10-05-2026
Spent some time on this today and wanted to compare notes.
I'm comparing two approaches here: keep it simple on A6000, or squeeze more out of the stack and deal with the complexity.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it.
Re: Help with Embeddings - paperport64 - 10-05-2026
Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt? Turns out 'just one more test' was a lie.
Re: Help with Embeddings - rasterhall - 10-06-2026
I'd start with the simpler stack.