Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
throughput per watt reality check for Qwen
#1
Spent some time on this today and wanted to compare notes.

I've gone back and forth between vLLM and llama.cpp for Llama. The interesting difference for me has been token cost.

Trying to avoid rebuilding the whole thing twice.
Reply


Messages In This Thread
throughput per watt reality check for Qwen - by deltapoint17 - 10-14-2026, 09:36 PM

Forum Jump:


Users browsing this thread: 1 Guest(s)