Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
batching changes after update
#1
Thought I'd post a small recipe because a lot of threads ask similar things.

This isn't revolutionary, but the combination of PyTorch and M3 Max felt surprisingly usable once I tuned around prefill/decode split.

If someone wants the exact settings I can clean them up and post them.

For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
still benchmarking everything
Reply


Messages In This Thread
batching changes after update - by audioriver - 09-17-2026, 12:15 AM
Re: batching changes after update - by amberkite - 09-18-2026, 12:38 AM
Re: batching changes after update - by kernelmike - 09-21-2026, 08:58 AM
Re: batching changes after update - by mangohouse - 09-24-2026, 02:15 PM
Re: batching changes after update - by dockember - 09-24-2026, 03:10 PM
Re: batching changes after update - by thetapath - 09-26-2026, 07:38 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)