10-07-2026, 08:59 PM
Thanks, that helps. I ended up in about the same place using vLLM. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
|
tokens/sec tuning ideas: worth it?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
tokens/sec tuning ideas: worth it? - by macronest - 09-29-2026, 01:11 AM
Re: tokens/sec tuning ideas: worth it? - by northhall88 - 09-30-2026, 01:40 AM
Re: tokens/sec tuning ideas: worth it? - by marbletrack - 10-01-2026, 02:30 AM
Re: tokens/sec tuning ideas: worth it? - by cozygrid12 - 10-01-2026, 03:38 AM
Re: tokens/sec tuning ideas: worth it? - by vectorhouse71 - 10-02-2026, 04:08 PM
Re: tokens/sec tuning ideas: worth it? - by northgarden37 - 10-02-2026, 08:48 PM
Re: tokens/sec tuning ideas: worth it? - by northgrid33 - 10-03-2026, 09:26 PM
Re: tokens/sec tuning ideas: worth it? - by cachelab - 10-03-2026, 10:31 PM
Re: tokens/sec tuning ideas: worth it? - by macrotinker - 10-04-2026, 10:34 AM
Re: tokens/sec tuning ideas: worth it? - by sparrowghost - 10-04-2026, 06:56 PM
Re: tokens/sec tuning ideas: worth it? - by fastfield4 - 10-04-2026, 08:37 PM
Re: tokens/sec tuning ideas: worth it? - by cudaworks - 10-07-2026, 08:59 PM
|
Users browsing this thread: 1 Guest(s)