+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Model Merging (https://www.datasculpting.ai/inference/forumdisplay.php?fid=57)
+--- Thread: sqlite + embeddings surprisingly ok (/showthread.php?tid=1471)
Pages:
1
2
Re: sqlite + embeddings surprisingly ok - macrolab - 10-19-2026
Quote:I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.
I tested this tonight. On 7900 XTX with PyTorch, I saw basically the same behavior. The surprise was that memory pressure showed up before throughput collapsed.
Re: sqlite + embeddings surprisingly ok - deepseeked - 10-19-2026
Ran a quick check on my box. On mini PC with MLX, I saw basically the same behavior.
Re: sqlite + embeddings surprisingly ok - phasetrack - 10-19-2026
A couple things I'd check first. Before rebuilding anything, I'd test one clean baseline with Llama and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Re: sqlite + embeddings surprisingly ok - phasenode - 10-19-2026
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher.
Re: sqlite + embeddings surprisingly ok - batchember - 10-19-2026
I don't think that's the whole story. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.
Re: sqlite + embeddings surprisingly ok - bytegarden73 - 10-19-2026
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was latency, not quality.