|
quant choices for 70B local on GB200
|
10-15-2026, 06:59 AM
Quote:I'd approach it in a boring order. Before rebuilding anything, I'd test one clean baseline with Kimi and compare from there. A lot of these threads en that fixed it for me too. If you post your exact settings, people here can probably narrow it down pretty fast.
curious and caffeinated
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
quant choices for 70B local on GB200 - by cudaline - 10-13-2026, 04:23 AM
Re: quant choices for 70B local on GB200 - by cobalttinker - 10-13-2026, 04:51 AM
Re: quant choices for 70B local on GB200 - by vrambandit - 10-13-2026, 05:31 PM
Re: quant choices for 70B local on GB200 - by paperrunner - 10-15-2026, 06:16 AM
Re: quant choices for 70B local on GB200 - by fusedtinker - 10-15-2026, 06:59 AM
Re: quant choices for 70B local on GB200 - by benchplease - 10-15-2026, 08:27 AM
|
