Inference
sqlite + embeddings surprisingly ok for Mistral - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Model Merging (https://www.datasculpting.ai/inference/forumdisplay.php?fid=57)
+--- Thread: sqlite + embeddings surprisingly ok for Mistral (/showthread.php?tid=190)



sqlite + embeddings surprisingly ok for Mistral - tensorfield88 - 09-08-2026

Spent some time on this today and wanted to compare notes.

I'm comparing two approaches here: keep it simple on M3 Max, or squeeze more out of the stack and deal with the complexity.

Trying to avoid rebuilding the whole thing twice. The logs were somehow calmer than I was.


Re: sqlite + embeddings surprisingly ok for Mistral - oxiderunner - 09-08-2026

A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.