sqlite + embeddings surprisingly ok for Mixtral

[sparrowworks88]

I'm trying to sanity-check my setup.

I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling speculative decoding.

Would appreciate practical advice rather than theory.