Inference
hybrid retrieval results for FLUX - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14)
+--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58)
+--- Thread: hybrid retrieval results for FLUX (/showthread.php?tid=775)

Pages: 1 2


hybrid retrieval results for FLUX - homelabhenry - 10-05-2026

Posting this in case it saves someone else a little time.

I'm not trying to build a perfect architecture diagram. I just want a sane starting point around Ollama and GB200.

I'm especially interested in mistakes worth avoiding.

This is mostly for local work rather than public serving.


Re: hybrid retrieval results for FLUX - tensorfield88 - 10-07-2026

A couple questions before I guess too hard. Is this local-only or are you routing anything externally?


Re: hybrid retrieval results for FLUX - homelabhenry - 10-07-2026

I hit almost the same issue last night.


Re: hybrid retrieval results for FLUX - tensorfield88 - 10-07-2026

Can you fill in a bit more context? What model, what runtime, and roughly what context size?


Re: hybrid retrieval results for FLUX - phasescope - 10-08-2026

subscribed, curious where this lands. I keep promising myself this is the last rebuild.


Re: hybrid retrieval results for FLUX - homelabhenry - 10-08-2026

I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.


Re: hybrid retrieval results for FLUX - routeforge64 - 10-08-2026

Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?


Re: hybrid retrieval results for FLUX - quietsupply11 - 10-09-2026

that fixed it for me too.

I'm happy to test one more variant if you want a second data point.


Re: hybrid retrieval results for FLUX - cacheworks - 10-10-2026

What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt?


Re: hybrid retrieval results for FLUX - tinycontext - 10-10-2026

worth checking the driver first.

If you post your exact settings, people here can probably narrow it down pretty fast.