Inference
›
Optimization & Performance
›
Quantization
›
quant choices for 70B local: what are you seeing?
Who Posted?
Who Posted?
| Total Posts: 10 | |
| User | # Posts |
| fusedtinker | 1 |
| vrambandit | 1 |
| llmarch51 | 1 |
| bytehall | 1 |
| benchplease | 1 |
| northquill | 1 |
| southtinker | 1 |
| llmarch83 | 1 |
| relaynest82 | 1 |
| vectorport | 1 |