10-14-2026, 10:20 AM
Quote:[quote]Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. The main thing that moved was laten
Ran a quick check on my box. On mini PC with PyTorch, I saw basically the same behavior. The main thing that moved was latency, not quality.
If you post your exact settings, people here can probably narrow it down pretty fast.
throughput matters, but tail latency matters too