10-01-2026, 08:49 PM
A couple questions before I guess too hard. What model, what runtime, and roughly what context size?
Apple Silicon • MLX mostly
|
tokens/sec tuning ideas
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
tokens/sec tuning ideas - by rocmriley - 09-25-2026, 04:56 AM
Re: tokens/sec tuning ideas - by oxidemixer - 09-27-2026, 05:12 AM
Re: tokens/sec tuning ideas - by thetarunner - 09-30-2026, 06:01 AM
Re: tokens/sec tuning ideas - by cozyarch - 09-30-2026, 06:41 PM
Re: tokens/sec tuning ideas - by macroforge - 10-01-2026, 07:04 PM
Re: tokens/sec tuning ideas - by labnest - 10-01-2026, 08:49 PM
Re: tokens/sec tuning ideas - by vramridge - 10-04-2026, 08:57 PM
|
Users browsing this thread: 1 Guest(s)