Inference › Inference Engines › Other Engines v
tokens/sec tuning ideas: worth it?

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
tokens/sec tuning ideas: worth it?
marbletrack Offline
Member
***
Posts: 61
Threads: 6
Joined: Sep 2026
Reputation: 0
#3
10-01-2026, 02:30 AM
Tried to reproduce it just now. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.

If you post your exact settings, people here can probably narrow it down pretty fast.
Find
Reply


Messages In This Thread
tokens/sec tuning ideas: worth it? - by macronest - 09-29-2026, 01:11 AM
Re: tokens/sec tuning ideas: worth it? - by marbletrack - 10-01-2026, 02:30 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)