10-19-2026, 04:28 AM
Quote:Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up
I'd start with the simpler stack.
curious and caffeinated
|
working config for 32k context
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
working config for 32k context - by cachebench - 10-17-2026, 01:08 AM
Re: working config for 32k context - by rocmriley - 10-18-2026, 06:59 PM
Re: working config for 32k context - by audionode8 - 10-18-2026, 09:52 PM
Re: working config for 32k context - by llmpeak - 10-18-2026, 10:05 PM
Re: working config for 32k context - by mangoquill - 10-18-2026, 10:17 PM
Re: working config for 32k context - by audioforge - 10-18-2026, 11:09 PM
Re: working config for 32k context - by cacheplane98 - 10-19-2026, 12:00 AM
Re: working config for 32k context - by mangoquill - 10-19-2026, 01:33 AM
Re: working config for 32k context - by mintstation99 - 10-19-2026, 01:51 AM
Re: working config for 32k context - by modgarden - 10-19-2026, 04:28 AM
|
Users browsing this thread: 1 Guest(s)