10-15-2026, 10:55 AM
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at speculative decoding. Not glamorous advice, but repeatable baselines save a lot of time.
|
what are you all running this week for Mixtral
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)