10-19-2026, 12:34 AM
Appreciate the detail. That matches what I saw on Threadripper box. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
mostly local
|
tokens/sec tuning ideas: what are you seeing?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
tokens/sec tuning ideas: what are you seeing? - by circuitkite - 10-18-2026, 05:28 PM
Re: tokens/sec tuning ideas: what are you seeing? - by stackpilot - 10-18-2026, 06:49 PM
Re: tokens/sec tuning ideas: what are you seeing? - by audiopoint18 - 10-18-2026, 07:28 PM
Re: tokens/sec tuning ideas: what are you seeing? - by turbosupply83 - 10-18-2026, 08:02 PM
Re: tokens/sec tuning ideas: what are you seeing? - by vramport - 10-19-2026, 12:34 AM
Re: tokens/sec tuning ideas: what are you seeing? - by vrambandit - 10-19-2026, 01:24 AM
Re: tokens/sec tuning ideas: what are you seeing? - by torchstation - 10-19-2026, 03:32 AM
Re: tokens/sec tuning ideas: what are you seeing? - by turbosupply83 - 10-19-2026, 04:13 AM
Re: tokens/sec tuning ideas: what are you seeing? - by tinycontext - 10-18-2026, 08:16 PM
|
Users browsing this thread: 1 Guest(s)