Inference
A quick note about forum organization - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Announcements (https://www.datasculpting.ai/inference/forumdisplay.php?fid=5)
+--- Forum: Forum Announcements (https://www.datasculpting.ai/inference/forumdisplay.php?fid=6)
+--- Thread: A quick note about forum organization (/showthread.php?tid=4)

Pages: 1 2


Re: A quick note about forum organization - Data Sculpting - 08-29-2026

That matches what I was seeing. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more optimization layer.


Re: A quick note about forum organization - embershed99 - 08-29-2026

Quote:That matches what I was seeing. That matches what I saw on mini PC. The biggest change for me was simplifying the stack instead of adding one more opt

That matches what I was seeing. The pattern around INT4 has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.


Re: A quick note about forum organization - Data Sculpting - 08-29-2026

That matches what I was seeing. That matches what I saw on A6000. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.