+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Vector Databases (https://www.datasculpting.ai/inference/forumdisplay.php?fid=60)
+--- Thread: Help with Vector Databases for DeepSeek (/showthread.php?tid=1091)
Pages:
1
2
Re: Help with Vector Databases for DeepSeek - amberhall - 10-19-2026
I don't think that's the whole story. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Re: Help with Vector Databases for DeepSeek - fastfield4 - 10-19-2026
I'd approach it in a boring order. If you're on PyTorch, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
Re: Help with Vector Databases for DeepSeek - emberquill - 10-19-2026
What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?