Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Forum structure feedback thread on 4090
#11
Appreciate the detail. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
Reply
#12
Interesting, I hadn't tried that. I ended up in about the same place using Ollama.
Reply
#13
I think the bottleneck is somewhere else. I've seen people blame NVFP4 when the real issue was much more mundane.
Reply
#14
Quote:I think the bottleneck is somewhere else. I've seen people blame NVFP4 when the real issue was much more mundane.

Not sure I agree there. I've seen people blame consumer GPUs when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
Reply
#15
Good point. That matches what I saw on 4090.
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)