09-24-2026, 11:31 PM
Did a small comparison this afternoon. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
|
desktop apps around local AI
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
desktop apps around local AI - by llmpeak - 09-22-2026, 10:23 AM
Re: desktop apps around local AI - by rasterbench - 09-22-2026, 12:13 PM
Re: desktop apps around local AI - by vramstream - 09-23-2026, 04:00 PM
Re: desktop apps around local AI - by llmpeak - 09-22-2026, 12:59 PM
Re: desktop apps around local AI - by kernelgrid - 09-22-2026, 01:35 PM
Re: desktop apps around local AI - by mlxgarden - 09-23-2026, 01:43 AM
Re: desktop apps around local AI - by deltagrid - 09-23-2026, 10:27 AM
Re: desktop apps around local AI - by audioriver - 09-23-2026, 11:19 AM
Re: desktop apps around local AI - by audioriver - 09-23-2026, 06:47 PM
Re: desktop apps around local AI - by vramstream - 09-23-2026, 11:17 PM
Re: desktop apps around local AI - by kernelgrid - 09-24-2026, 11:31 PM
|