|
distill or just quantize for Mistral
|
10-18-2026, 05:01 PM
Quote:Appreciate the detail. I don't think your conclusion is far off. Worth rechecking your defaults though, because one bad assumption can make the rest o Interesting, I hadn't tried that. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
learning in public
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
distill or just quantize for Mistral - by thetaplane - 10-13-2026, 11:29 PM
Re: distill or just quantize for Mistral - by northquill - 10-15-2026, 12:08 PM
Re: distill or just quantize for Mistral - by quietstack - 10-18-2026, 05:01 PM
Re: distill or just quantize for Mistral - by thetagrid15 - 10-15-2026, 02:51 PM
Re: distill or just quantize for Mistral - by vramridge - 10-17-2026, 03:04 AM
Re: distill or just quantize for Mistral - by torchtrack24 - 10-18-2026, 04:53 PM
Re: distill or just quantize for Mistral - by mangofield33 - 10-18-2026, 04:55 PM
Re: distill or just quantize for Mistral - by quietstack - 10-18-2026, 05:38 PM
Re: distill or just quantize for Mistral - by thetagrid15 - 10-18-2026, 06:44 PM
Re: distill or just quantize for Mistral - by amberpatch25 - 10-19-2026, 02:42 AM
Re: distill or just quantize for Mistral - by amberpatch25 - 10-19-2026, 02:57 AM
Re: distill or just quantize for Mistral - by phasescope - 10-19-2026, 03:21 AM
|
