10-19-2026, 03:05 AM
I think the bottleneck is somewhere else. I've seen people blame speculative decoding when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
|
long context that stayed useful: what are you seeing?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
long context that stayed useful: what are you seeing? - by tensorriver - 10-17-2026, 04:42 AM
Re: long context that stayed useful: what are you seeing? - by sanepeak48 - 10-17-2026, 05:05 PM
Re: long context that stayed useful: what are you seeing? - by emberquill - 10-18-2026, 10:13 PM
Re: long context that stayed useful: what are you seeing? - by vrampilot - 10-18-2026, 06:28 PM
Re: long context that stayed useful: what are you seeing? - by emberquill - 10-19-2026, 02:14 AM
Re: long context that stayed useful: what are you seeing? - by plainember52 - 10-19-2026, 12:54 AM
Re: long context that stayed useful: what are you seeing? - by tinycontext - 10-19-2026, 02:35 AM
Re: long context that stayed useful: what are you seeing? - by latentscope35 - 10-19-2026, 03:05 AM
|