08-31-2026, 09:53 PM
Quote:Quote:Appreciate the detail. That matches what I saw on 7900 XTX.
Interesting, I hadn't tried that. I ended up in about the same place using vLLM.
trying not to rebuild again
|
working config for 32k context for Llama
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)