Inference
Forum structure feedback thread on 4090 - Printable Version

+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Announcements (https://www.datasculpting.ai/inference/forumdisplay.php?fid=5)
+--- Forum: Community Announcements (https://www.datasculpting.ai/inference/forumdisplay.php?fid=7)
+--- Thread: Forum structure feedback thread on 4090 (/showthread.php?tid=344)

Pages: 1 2


Re: Forum structure feedback thread on 4090 - fastlab - 09-28-2026

Appreciate the detail. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.


Re: Forum structure feedback thread on 4090 - deltastation - 09-28-2026

Interesting, I hadn't tried that. I ended up in about the same place using Ollama.


Re: Forum structure feedback thread on 4090 - labpath - 09-28-2026

I think the bottleneck is somewhere else. I've seen people blame NVFP4 when the real issue was much more mundane.


Re: Forum structure feedback thread on 4090 - signalcraft14 - 09-28-2026

Quote:I think the bottleneck is somewhere else. I've seen people blame NVFP4 when the real issue was much more mundane.

Not sure I agree there. I've seen people blame consumer GPUs when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.


Re: Forum structure feedback thread on 4090 - kernelarch - 09-29-2026

Good point. That matches what I saw on 4090.