Inference
non-AI thing you built recently - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: Off Topic (https://www.datasculpting.ai/inference/forumdisplay.php?fid=27)
+--- Thread: non-AI thing you built recently (/showthread.php?tid=54)

Pages: 1 2


Re: non-AI thing you built recently - localtinker - 09-04-2026

Quote:My first guess would be this: On A6000, the easiest win is often to back off the aggressive settings and see whether the problem survives. A lot of th

That matches what I was seeing. That matches what I saw on Threadripper box. The biggest change for me was simplifying the stack instead of adding one more optimization layer.


Re: non-AI thing you built recently - mlxgarden - 09-05-2026

Appreciate the detail. The pattern around embeddings has been pretty similar for me.


Re: non-AI thing you built recently - sparrowhall - 09-08-2026

Quote:Appreciate the detail. The pattern around embeddings has been pretty similar for me.

That matches what I was seeing. That matches what I saw on dual 3090.