09-05-2026, 11:33 PM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. The surprise was that memory pressure showed up before throughput collapsed.
|
working config for 32k context for Llama
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)