10-12-2026, 02:50 AM
Good point. That matches what I saw on dual 3090. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
7900 XTX / ROCm / somehow still optimistic
|
quant choices for 70B local
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
quant choices for 70B local - by phasestream53 - 10-12-2026, 02:02 AM
Re: quant choices for 70B local - by rocmriley - 10-12-2026, 02:50 AM
Re: quant choices for 70B local - by benchplease - 10-12-2026, 03:03 PM
|
Users browsing this thread: 1 Guest(s)