Inference
vector DB that stayed out of the way - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Model Merging (https://www.datasculpting.ai/inference/forumdisplay.php?fid=57)
+--- Thread: vector DB that stayed out of the way (/showthread.php?tid=76)



vector DB that stayed out of the way - mangoquill - 08-30-2026

Maybe I'm missing something obvious.

I'm mostly working with Llama in vLLM on mini PC. The part I'm trying to understand is consumer GPUs.

Would appreciate practical advice rather than theory.