Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
how strict do you make schemas for Mistral
#16
Quote:Maybe, but I had the opposite result. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Wort

Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The surprise was that memory pressure showed up before throughput collapsed. At this point the real bottleneck is my patience.
Reply


Messages In This Thread
Re: how strict do you make schemas for Mistral - by macrolab - 10-19-2026, 03:32 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)