+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Model Merging (https://www.datasculpting.ai/inference/forumdisplay.php?fid=57)
+--- Thread: vector DB that stayed out of the way (/showthread.php?tid=246)
Pages:
1
2
Re: vector DB that stayed out of the way - torchsupply99 - 09-19-2026
subscribed, curious where this lands.
Re: vector DB that stayed out of the way - syshouse - 09-20-2026
Appreciate the detail. I ended up in about the same place using TensorRT-LLM.
Re: vector DB that stayed out of the way - rasterbench - 09-20-2026
Interesting, I hadn't tried that. I don't think your conclusion is far off.
Re: vector DB that stayed out of the way - mlxgarden - 09-20-2026
Quote:Interesting, I hadn't tried that. I don't think your conclusion is far off.
following this because I'm in the same boat.
Re: vector DB that stayed out of the way - routecraft - 09-20-2026
What worked for me was pretty simple. On B200, the easiest win is often to back off the aggressive settings and see whether the problem survives. Not glamorous advice, but repeatable baselines save a lot of time.
Re: vector DB that stayed out of the way - vrambandit - 09-21-2026
following this because I'm in the same boat.