10-05-2026, 12:42 AM
Quote:I don't think that's the whole story. I get why that seems right, but on dual 3090 the bottleneck felt elsewhere.
Ran a quick check on my box. My result was mixed: first run looked bad, second run looked normal. I expected the model choice to matter more than it did.
I'm happy to test one more variant if you want a second data point. Turns out 'just one more test' was a lie.
context windows are not a product strategy