08-28-2026, 04:57 AM
Tried to reproduce it just now. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it did.
|
distill or just quantize for DeepSeek
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)