Vector Databases discussion on mini PC

[orbitbench6]

I'm trying to sanity-check my setup.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.

If you've tested something similar, what did you keep and what did you stop bothering with?

[fusedhall]

I'm trying to sanity-check my setup.

I'd start with the simpler stack.

[flintriver50]

I'm trying to sanity-check my setup.

same here on my side.