10-10-2026, 06:53 AM
Curious what people here are seeing.
I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.
Would appreciate practical advice rather than theory.
This is mostly for local work rather than public serving.
I'm trying to decide whether to keep the current stack or change course. Main question is how people here are handling tokens/sec.
Would appreciate practical advice rather than theory.
This is mostly for local work rather than public serving.
small models can still be useful