|
small win thread for Mixtral
|
08-31-2026, 08:01 PM
Quote:Ran a quick check on my box. On B200 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did. A couple questions before I guess too hard. What model, what runtime, and roughly what context size?
small models can still be useful
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
small win thread for Mixtral - by routecraft - 08-26-2026, 05:18 AM
Re: small win thread for Mixtral - by quiettoken - 08-28-2026, 05:22 AM
Re: small win thread for Mixtral - by tensorkite - 08-28-2026, 01:53 PM
Re: small win thread for Mixtral - by quiettoken - 08-28-2026, 02:39 PM
Re: small win thread for Mixtral - by ggufwire22 - 08-31-2026, 09:33 PM
Re: small win thread for Mixtral - by rocmrunner40 - 08-28-2026, 03:20 PM
Re: small win thread for Mixtral - by ggufwire22 - 08-31-2026, 03:31 PM
Re: small win thread for Mixtral - by quiettoken - 08-31-2026, 08:01 PM
|
