09-09-2026, 08:48 PM
Did a small comparison this afternoon. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
measure twice, benchmark three times
|
speculative decoding actually worth it
|
|
« Next Oldest | Next Newest »
|
Users browsing this thread: 1 Guest(s)