Help with Vector Databases

[minthall]

Can you fill in a bit more context? What model, what runtime, and roughly what context size? I keep promising myself this is the last rebuild.

I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.