Inference
›
Optimization & Performance
›
Quantization
›
quant choices for 70B local on GB200
Who Posted?
Who Posted?
| Total Posts: 6 | |
| User | # Posts |
| cudaline | 1 |
| fusedtinker | 1 |
| cobalttinker | 1 |
| paperrunner | 1 |
| benchplease | 1 |
| vrambandit | 1 |
Who Posted?
| Total Posts: 6 | |
| User | # Posts |
| cudaline | 1 |
| fusedtinker | 1 |
| cobalttinker | 1 |
| paperrunner | 1 |
| benchplease | 1 |
| vrambandit | 1 |