10-06-2026, 01:16 PM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
|
structured output failures: worth it?
|
|
10-06-2026, 01:16 PM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
10-06-2026, 02:30 PM
My first guess would be this: On M3 Max, the easiest win is often to back off the aggressive settings and see whether the problem survives.
|
|
« Next Oldest | Next Newest »
|