Inference › RAG & Knowledge Systems › Vector Databases
Help with Vector Databases

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
Help with Vector Databases
tinycontext Offline
Member
***
Posts: 112
Threads: 12
Joined: Sep 2026
Reputation: 0
#8
09-20-2026, 04:52 AM
Quote:I think the bottleneck is somewhere else. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere.

I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
context windows are not a product strategy
Find
Reply


Messages In This Thread
Help with Vector Databases - by macronest - 09-15-2026, 10:53 PM
Re: Help with Vector Databases - by emberquill - 09-17-2026, 11:40 AM
Re: Help with Vector Databases - by tinycontext - 09-17-2026, 12:46 PM
Re: Help with Vector Databases - by orbitbench6 - 09-18-2026, 03:40 PM
Re: Help with Vector Databases - by tinycontext - 09-20-2026, 04:52 AM
Re: Help with Vector Databases - by orbitgarden - 09-20-2026, 01:08 PM
Re: Help with Vector Databases - by orbitbench6 - 09-18-2026, 01:06 PM
Re: Help with Vector Databases - by thetaarch43 - 09-18-2026, 02:23 PM
Re: Help with Vector Databases - by minthall - 09-20-2026, 02:47 PM
Re: Help with Vector Databases - by emberquill - 09-20-2026, 04:21 AM
Re: Help with Vector Databases - by relayforge - 09-20-2026, 09:15 AM
Re: Help with Vector Databases - by orbitbench6 - 09-20-2026, 11:55 AM
Re: Help with Vector Databases - by macronest - 09-20-2026, 07:23 PM
Re: Help with Vector Databases - by cacheline - 09-21-2026, 04:12 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)