+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Vector Databases (https://www.datasculpting.ai/inference/forumdisplay.php?fid=60)
+--- Thread: Vector Databases discussion: anyone testing this? (/showthread.php?tid=1096)
Pages:
1
2
Vector Databases discussion: anyone testing this? - turboyard94 - 10-12-2026
Posting this in case it saves someone else a little time.
If you were starting from scratch today for this use case, what would you choose first and what would you ignore?
I'm especially interested in mistakes worth avoiding.
My use case is pretty ordinary: local chat, some document work, and occasional batch jobs.
Re: Vector Databases discussion: anyone testing this? - deltagrid - 10-13-2026
Good point. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
Re: Vector Databases discussion: anyone testing this? - torchshed - 10-13-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. Not glamorous advice, but repeatable baselines save a lot of time.
Re: Vector Databases discussion: anyone testing this? - llmarch51 - 10-13-2026
following this because I'm in the same boat.
Re: Vector Databases discussion: anyone testing this? - emberquill - 10-13-2026
That matches what I was seeing. That matches what I saw on A6000.
Re: Vector Databases discussion: anyone testing this? - vramarch - 10-13-2026
I don't think that's the whole story. I've seen people blame HBM constraints when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.
Re: Vector Databases discussion: anyone testing this? - fastfield4 - 10-16-2026
I'd approach it in a boring order. On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. Once you know the plain path works, then add the faster path back in piece by piece.
Re: Vector Databases discussion: anyone testing this? - tinycontext - 10-18-2026
Can you fill in a bit more context? Are you testing this on M3 Max or something else?
There are a few different conversations hiding inside this thread, so being explicit about the goal helps.
Re: Vector Databases discussion: anyone testing this? - orbitbench6 - 10-18-2026
Quote:Can you fill in a bit more context? Are you testing this on M3 Max or something else?
I hit almost the same issue last night.
Re: Vector Databases discussion: anyone testing this? - southspark - 10-18-2026
Maybe, but I had the opposite result. I get why that seems right, but on 5090 the bottleneck felt elsewhere.