10-04-2026, 08:37 PM
That matches what I was seeing. The pattern around INT4 has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
|
tokens/sec tuning ideas: worth it?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
tokens/sec tuning ideas: worth it? - by macronest - 09-29-2026, 01:11 AM
Re: tokens/sec tuning ideas: worth it? - by northhall88 - 09-30-2026, 01:40 AM
Re: tokens/sec tuning ideas: worth it? - by marbletrack - 10-01-2026, 02:30 AM
Re: tokens/sec tuning ideas: worth it? - by cozygrid12 - 10-01-2026, 03:38 AM
Re: tokens/sec tuning ideas: worth it? - by vectorhouse71 - 10-02-2026, 04:08 PM
Re: tokens/sec tuning ideas: worth it? - by northgarden37 - 10-02-2026, 08:48 PM
Re: tokens/sec tuning ideas: worth it? - by northgrid33 - 10-03-2026, 09:26 PM
Re: tokens/sec tuning ideas: worth it? - by cachelab - 10-03-2026, 10:31 PM
Re: tokens/sec tuning ideas: worth it? - by macrotinker - 10-04-2026, 10:34 AM
Re: tokens/sec tuning ideas: worth it? - by sparrowghost - 10-04-2026, 06:56 PM
Re: tokens/sec tuning ideas: worth it? - by fastfield4 - 10-04-2026, 08:37 PM
Re: tokens/sec tuning ideas: worth it? - by cudaworks - 10-07-2026, 08:59 PM
|