Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
vector DB that stayed out of the way
#1
Maybe I'm missing something obvious.

I'm mostly working with Llama in vLLM on mini PC. The part I'm trying to understand is consumer GPUs.

Would appreciate practical advice rather than theory.
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)