09-17-2026, 07:13 PM
Ran a quick check on my box. On Threadripper box with LM Studio, I saw basically the same behavior.
Inference
›
Optimization & Performance
›
Quantization
quant choices for 70B local: what are you seeing?
quant choices for 70B local: what are you seeing?
|
quant choices for 70B local: what are you seeing?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
quant choices for 70B local: what are you seeing? - by vectorport - 09-13-2026, 06:44 PM
Re: quant choices for 70B local: what are you seeing? - by relaynest82 - 09-13-2026, 11:24 PM
Re: quant choices for 70B local: what are you seeing? - by llmarch83 - 09-14-2026, 03:43 AM
Re: quant choices for 70B local: what are you seeing? - by southtinker - 09-15-2026, 04:28 AM
Re: quant choices for 70B local: what are you seeing? - by northquill - 09-15-2026, 05:15 PM
Re: quant choices for 70B local: what are you seeing? - by benchplease - 09-15-2026, 05:57 PM
Re: quant choices for 70B local: what are you seeing? - by bytehall - 09-17-2026, 06:36 AM
Re: quant choices for 70B local: what are you seeing? - by llmarch51 - 09-17-2026, 07:13 PM
Re: quant choices for 70B local: what are you seeing? - by vrambandit - 09-17-2026, 07:52 PM
Re: quant choices for 70B local: what are you seeing? - by fusedtinker - 09-18-2026, 12:01 AM
|
Users browsing this thread: