vector DB that stayed out of the way: anyone testing this?

[quietarch]

Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly.

[relayforge]

Not sure I agree there. I get why that seems right, but on 7900 XTX the bottleneck felt elsewhere.

[cacheplane98]

My first guess would be this: On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives.

[benchplease]

A couple things I'd check first. If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious.