Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
embedding model you trust on 7900 XTX
#12
Quote:I tested this tonight. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not qual

I'd start with the simpler stack.
throughput matters, but tail latency matters too
Reply


Messages In This Thread
Re: embedding model you trust on 7900 XTX - by batchsize - 10-19-2026, 02:05 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)