Inference › Evaluation & Testing › Benchmarks v
comparing models without fooling yourself with PyTorch

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
comparing models without fooling yourself with PyTorch
batchsize Offline
Member
***
Posts: 137
Threads: 16
Joined: Sep 2026
Reputation: 0
#15
10-17-2026, 01:56 AM
I tested this tonight. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.

If you post your exact settings, people here can probably narrow it down pretty fast.
throughput matters, but tail latency matters too
Find
Reply


Messages In This Thread
Re: comparing models without fooling yourself with PyTorch - by batchsize - 10-17-2026, 01:56 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)