Vector Databases discussion: anyone testing this?

[southspark]

I think the bottleneck is somewhere else. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model.