10-14-2026, 07:58 AM
Not sure I agree there. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Worth testing the simpler explanation before adopting the more interesting one.
|
quant choices for 70B local for Llama
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
quant choices for 70B local for Llama - by llmarch51 - 10-13-2026, 06:56 PM
Re: quant choices for 70B local for Llama - by vrambandit - 10-13-2026, 07:14 PM
Re: quant choices for 70B local for Llama - by southtinker - 10-14-2026, 07:58 AM
Re: quant choices for 70B local for Llama - by northquill - 10-15-2026, 08:20 AM
Re: quant choices for 70B local for Llama - by vrambandit - 10-15-2026, 10:25 AM
Re: quant choices for 70B local for Llama - by quiettoken - 10-16-2026, 11:03 PM
|
Users browsing this thread: 1 Guest(s)