10-19-2026, 02:58 AM
Interesting, I hadn't tried that. I don't think your conclusion is far off. The biggest change for me was simplifying the stack instead of adding one more optimization layer.
|
context size vs speed in GGUF: worth it?
|
|
« Next Oldest | Next Newest »
|