+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: Search / Retrieval / Reranking (https://www.datasculpting.ai/inference/forumdisplay.php?fid=61)
+--- Thread: Search / Retrieval / Reranking discussion for Gemma (/showthread.php?tid=698)
Search / Retrieval / Reranking discussion for Gemma - dockworks23 - 10-03-2026
Did a bit of testing and thought I'd post the result here.
After a few runs on mini PC, I ended up with decent performance, but the setup only really made sense once I adjusted around HBM constraints.
Nothing scientific here, just practical notes from a real setup.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
Re: Search / Retrieval / Reranking discussion for Gemma - deepseeked - 10-05-2026
I hit almost the same issue last night.
Re: Search / Retrieval / Reranking discussion for Gemma - localcraft17 - 10-06-2026
Can you fill in a bit more context? What model, what runtime, and roughly what context size?