sqlite + embeddings surprisingly ok for Mixtral

[turboyard94]

Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?

[quietsupply11]

Good point. That matches what I saw on Threadripper box. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

[localtinker]

same here on my side.

[cacheplane98]

following this because I'm in the same boat.