Inference
embedding model you trust: anyone testing this? - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Training & Customization (https://www.datasculpting.ai/inference/forumdisplay.php?fid=13)
+--- Forum: Dataset Creation / Curation (https://www.datasculpting.ai/inference/forumdisplay.php?fid=56)
+--- Thread: embedding model you trust: anyone testing this? (/showthread.php?tid=743)



embedding model you trust: anyone testing this? - torchstation - 10-04-2026

Thought I'd post a small recipe because a lot of threads ask similar things.

This isn't revolutionary, but the combination of SGLang and B200 felt surprisingly usable once I tuned around NVFP4.

If someone wants the exact settings I can clean them up and post them.


Re: embedding model you trust: anyone testing this? - sparrowgrid - 10-06-2026

Quote:Thought I'd post a small recipe because a lot of threads ask similar things.

I hit almost the same issue last night.