+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Model Merging (https://www.datasculpting.ai/inference/forumdisplay.php?fid=57)
+--- Thread: sqlite + embeddings surprisingly ok for Mixtral (/showthread.php?tid=1417)
Pages:
1
2
Re: sqlite + embeddings surprisingly ok for Mixtral - turboyard94 - 10-19-2026
Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?
Re: sqlite + embeddings surprisingly ok for Mixtral - quietsupply11 - 10-19-2026
Good point. That matches what I saw on Threadripper box. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Re: sqlite + embeddings surprisingly ok for Mixtral - localtinker - 10-19-2026
same here on my side.
Re: sqlite + embeddings surprisingly ok for Mixtral - cacheplane98 - 10-19-2026
following this because I'm in the same boat.