Inference
new here, what's your stack - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: new here, what's your stack (/showthread.php?tid=298)



new here, what's your stack - plaingarden18 - 09-15-2026

Posting this in case it saves someone else a little time.

I'm helping a small team set up a local workflow. We don't need a giant stack, but we do care about embeddings.

Would rather learn from your scars than collect my own all at once.


Re: new here, what's your stack - rocmplane - 09-15-2026

Ran a quick check on my box. The issue went away once I changed one setting and restarted the stack cleanly. The main thing that moved was latency, not quality.


Re: new here, what's your stack - vectorshed43 - 09-16-2026

Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?