10-07-2026, 09:39 PM
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at router policy.
|
TTS that sounds less fake
|
|
10-07-2026, 09:39 PM
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at router policy.
10-08-2026, 10:25 AM
Interesting, I hadn't tried that. That matches what I saw on dual 3090.
10-08-2026, 02:58 PM
I don't think that's the whole story. I wouldn't optimize around that first. On my side the bigger swing came from the runtime and not the model. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.
10-08-2026, 05:29 PM
My first guess would be this: Before rebuilding anything, I'd test one clean baseline with Phi and compare from there. A lot of these threads end up being one bad config plus a pile of conclusions drawn from it.
10-10-2026, 05:47 AM
Maybe, but I had the opposite result. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.
curious and caffeinated
|
|
« Next Oldest | Next Newest »
|