Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
quant support gaps for Mixtral
#5
Quote:Appreciate the detail. The pattern around token cost has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption

I'd approach it in a boring order. If you're on llama.cpp, I'd confirm the version first and then reduce variables until the behavior is obvious.
Reply


Messages In This Thread
quant support gaps for Mixtral - by syshouse - 10-12-2026, 06:47 PM
Re: quant support gaps for Mixtral - by routecrate - 10-15-2026, 04:05 AM
Re: quant support gaps for Mixtral - by labline - 10-17-2026, 12:15 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)