10-15-2026, 10:27 AM
Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. The surprise was that memory pressure showed up before throughput collapsed.
VRAM first, aesthetics later
|
4090 vs 5090 for 70B quants on mini PC
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)