08-31-2026, 09:25 PM
This keeps coming up in conversation so I figured I'd start a thread.
One thing I keep noticing is that people underestimate tokens/sec until they actually try to run this stuff for more than one afternoon.
Curious whether that lines up with what other people are seeing.
One thing I keep noticing is that people underestimate tokens/sec until they actually try to run this stuff for more than one afternoon.
Curious whether that lines up with what other people are seeing.