09-09-2026, 03:37 AM
My first guess would be this: If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious.
M3 Max • MLX • local-first
|
prompt length getting silly
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)