do you even need a vector DB here

[rocmrunner40]

Can you fill in a bit more context? What model, what runtime, and roughly what context size?

There are a few different conversations hiding inside this thread, so being explicit about the goal helps.