Inference › RAG & Knowledge Systems › Embeddings v
Help with Embeddings on 4090

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
Help with Embeddings on 4090
southtinker Offline
Member
***
Posts: 51
Threads: 11
Joined: Sep 2026
Reputation: 0
#1
09-30-2026, 03:48 AM
I figured I'd ask here before changing everything.

My current setup is TensorRT-LLM with 7900 XTX, and I keep running into NVFP4.

If you've tested something similar, what did you keep and what did you stop bothering with?
Find
Reply


Messages In This Thread
Help with Embeddings on 4090 - by southtinker - 09-30-2026, 03:48 AM
Re: Help with Embeddings on 4090 - by edgecoast - 10-04-2026, 08:27 AM
Re: Help with Embeddings on 4090 - by paperport64 - 10-01-2026, 06:54 AM
Re: Help with Embeddings on 4090 - by vramscope - 10-02-2026, 10:32 PM
Re: Help with Embeddings on 4090 - by quantnest - 10-04-2026, 07:15 AM
Re: Help with Embeddings on 4090 - by torchdesk - 10-04-2026, 09:30 AM
Re: Help with Embeddings on 4090 - by vramscope - 10-04-2026, 05:31 PM
Re: Help with Embeddings on 4090 - by quantnest - 10-04-2026, 11:37 PM
Re: Help with Embeddings on 4090 - by paperport64 - 10-05-2026, 02:07 AM
Re: Help with Embeddings on 4090 - by vramscope - 10-05-2026, 03:25 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)