Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Help with Embeddings: what are you seeing?
#1
Did a bit of testing and thought I'd post the result here.

I tried this with DeepSeek using SGLang on 7900 XTX. The headline result was better than I expected, but VRAM headroom still ended up being the limiting factor.

Curious if anyone else landed in the same place.

The part that surprised me was how much the boring details mattered more than the model choice.
Reply


Messages In This Thread
Help with Embeddings: what are you seeing? - by edgecoast - 09-13-2026, 09:21 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)