Inference
›
Optimization & Performance
›
Quantization
›
quant choices for 70B local: what are you seeing?
Who Posted?
Who Posted?
| Total Posts: 9 | |
| User | # Posts |
| phasestream53 | 1 |
| nanobrook | 1 |
| vramscope | 1 |
| mangofield33 | 1 |
| southtinker | 1 |
| oxidegrove40 | 1 |
| paperrunner | 1 |
| benchplease | 1 |
| vrambandit | 1 |