Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
comparing models without fooling yourself
#1
Thought I'd post a small recipe because a lot of threads ask similar things.

Maybe useful as a starting point: vLLM on M3 Max, keeping INT4 in mind from the start.

Feel free to tear it apart if you see something dumb.
Reply


Messages In This Thread
comparing models without fooling yourself - by kernelarch - 10-10-2026, 08:57 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)