Inference
Vector Databases discussion on mini PC - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Vector Databases (https://www.datasculpting.ai/inference/forumdisplay.php?fid=60)
+--- Thread: Vector Databases discussion on mini PC (/showthread.php?tid=343)



Vector Databases discussion on mini PC - orbitbench6 - 09-18-2026

I'm trying to sanity-check my setup.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.

If you've tested something similar, what did you keep and what did you stop bothering with?


Re: Vector Databases discussion on mini PC - fusedhall - 09-20-2026

Quote:I'm trying to sanity-check my setup.

I'd start with the simpler stack.


Re: Vector Databases discussion on mini PC - flintriver50 - 09-23-2026

Quote:
Quote:I'm trying to sanity-check my setup.

same here on my side.