throughput per watt reality check

[llmpeak]

My first guess would be this: If you're on vLLM, I'd confirm the version first and then reduce variables until the behavior is obvious. The logs were

Can you fill in a bit more context? What model, what runtime, and roughly what context size?