10-05-2026, 12:46 AM
Appreciate the detail. The pattern around tail latency has been pretty similar for me. Worth rechecking your defaults though, because one bad assumption can make the rest of the thread look confusing.
|
working config for 32k context
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
working config for 32k context - by mintstation99 - 10-04-2026, 12:34 AM
Re: working config for 32k context - by kernelgrid - 10-05-2026, 12:46 AM
Re: working config for 32k context - by rocmriley - 10-05-2026, 02:07 AM
Re: working config for 32k context - by cachebench - 10-05-2026, 04:38 AM
Re: working config for 32k context - by llmpeak - 10-05-2026, 05:26 AM
Re: working config for 32k context - by deltagrid - 10-05-2026, 07:00 AM
Re: working config for 32k context - by rocmriley - 10-05-2026, 11:37 AM
Re: working config for 32k context - by modgarden - 10-05-2026, 12:19 PM
Re: working config for 32k context - by visionforge - 10-06-2026, 12:42 PM
Re: working config for 32k context - by kernelgrid - 10-06-2026, 01:27 PM
Re: working config for 32k context - by rocmriley - 10-06-2026, 01:58 PM
Re: working config for 32k context - by benchplease - 10-06-2026, 04:15 PM
|
Users browsing this thread: 1 Guest(s)