![]() |
|
hybrid retrieval results for FLUX - Printable Version +- Inference (https://www.datasculpting.ai/inference) +-- Forum: RAG & Knowledge Systems (https://www.datasculpting.ai/inference/forumdisplay.php?fid=14) +--- Forum: RAG (https://www.datasculpting.ai/inference/forumdisplay.php?fid=58) +--- Thread: hybrid retrieval results for FLUX (/showthread.php?tid=775) Pages:
1
2
|
hybrid retrieval results for FLUX - homelabhenry - 10-05-2026 Posting this in case it saves someone else a little time. I'm not trying to build a perfect architecture diagram. I just want a sane starting point around Ollama and GB200. I'm especially interested in mistakes worth avoiding. This is mostly for local work rather than public serving. Re: hybrid retrieval results for FLUX - tensorfield88 - 10-07-2026 A couple questions before I guess too hard. Is this local-only or are you routing anything externally? Re: hybrid retrieval results for FLUX - homelabhenry - 10-07-2026 I hit almost the same issue last night. Re: hybrid retrieval results for FLUX - tensorfield88 - 10-07-2026 Can you fill in a bit more context? What model, what runtime, and roughly what context size? Re: hybrid retrieval results for FLUX - phasescope - 10-08-2026 subscribed, curious where this lands. I keep promising myself this is the last rebuild. Re: hybrid retrieval results for FLUX - homelabhenry - 10-08-2026 I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it. Re: hybrid retrieval results for FLUX - routeforge64 - 10-08-2026 Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt? Re: hybrid retrieval results for FLUX - quietsupply11 - 10-09-2026 that fixed it for me too. I'm happy to test one more variant if you want a second data point. Re: hybrid retrieval results for FLUX - cacheworks - 10-10-2026 What exact setup are you running? Do you see the same thing with a smaller batch or shorter prompt? Re: hybrid retrieval results for FLUX - tinycontext - 10-10-2026 worth checking the driver first. If you post your exact settings, people here can probably narrow it down pretty fast. |