Inference › RAG & Knowledge Systems › Embeddings v
Help with Embeddings

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
Help with Embeddings
torchdesk Offline
Junior Member
**
Posts: 36
Threads: 8
Joined: Aug 2026
Reputation: 0
#1
09-27-2026, 06:07 PM
Did a bit of testing and thought I'd post the result here.

After a few runs on mini PC, I ended up with decent performance, but the setup only really made sense once I adjusted around tail latency.

Nothing scientific here, just practical notes from a real setup.

This is mostly for local work rather than public serving.
Find
Reply


Messages In This Thread
Help with Embeddings - by torchdesk - 09-27-2026, 06:07 PM
Re: Help with Embeddings - by vectorshed43 - 09-29-2026, 06:14 AM
Re: Help with Embeddings - by vramscope - 09-29-2026, 06:31 AM
Re: Help with Embeddings - by rasterhall - 09-30-2026, 06:43 AM
Re: Help with Embeddings - by vramscope - 10-01-2026, 07:13 AM
Re: Help with Embeddings - by edgecoast - 10-01-2026, 09:43 AM
Re: Help with Embeddings - by rasterhall - 10-04-2026, 09:56 AM
Re: Help with Embeddings - by quantnest - 10-04-2026, 10:07 PM
Re: Help with Embeddings - by ggufwire22 - 10-05-2026, 10:40 PM
Re: Help with Embeddings - by paperport64 - 10-05-2026, 11:17 PM
Re: Help with Embeddings - by torchdesk - 10-06-2026, 12:43 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)