09-25-2026, 04:07 AM
Quote:Posting this in case it saves someone else a little time.
Did a small comparison this afternoon. On dual 3090 with TensorRT-LLM, I saw basically the same behavior. The main thing that moved was latency, not quality.
measure twice, benchmark three times