Vector Databases discussion with Ollama

[deltagrid]

Interesting, I hadn't tried that. The pattern around tokens/sec has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.