10-16-2026, 11:25 PM
Thanks, that helps. I ended up in about the same place using MLX.
|
working config for 32k context
|
|
10-16-2026, 11:25 PM
Thanks, that helps. I ended up in about the same place using MLX.
10-17-2026, 11:42 AM
I'd start with the simpler stack.
10-18-2026, 11:48 AM
I'd start with the simpler stack.
10-18-2026, 12:41 PM
I tested this tonight. On GB200 with PyTorch, I saw basically the same behavior. I expected the model choice to matter more than it did.
still benchmarking everything
|
|
« Next Oldest | Next Newest »
|