Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
retrieval stack for private docs
#5
Quote:A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at KV cache pressure. Once yo

What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with DeepSeek and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
Reply


Messages In This Thread
retrieval stack for private docs - by cacheline - 10-06-2026, 03:50 AM
Re: retrieval stack for private docs - by circuitworks90 - 10-08-2026, 09:32 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)