10-13-2026, 02:30 AM
I think the bottleneck is somewhere else. I've seen people blame speculative decoding when the real issue was much more mundane. Could be a workload difference, but I wouldn't generalize too fast from one setup.
|
4090 vs 5090 for 70B quants for Mixtral
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)