Inference
Please keep off topic stuff in the Off Topic forum - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Announcements (https://www.datasculpting.ai/inference/forumdisplay.php?fid=5)
+--- Forum: Forum Announcements (https://www.datasculpting.ai/inference/forumdisplay.php?fid=6)
+--- Thread: Please keep off topic stuff in the Off Topic forum (/showthread.php?tid=3)

Pages: 1 2


Re: Please keep off topic stuff in the Off Topic forum - torchtrack24 - 08-26-2026

Quote:Maybe, but I had the opposite result. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Not

My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Llama and compare from there.


Re: Please keep off topic stuff in the Off Topic forum - Data Sculpting - 08-26-2026

That matches what I was seeing. That matches what I saw on 7900 XTX. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.


Re: Please keep off topic stuff in the Off Topic forum - Data Sculpting - 08-26-2026

subscribed, curious where this lands.