10-19-2026, 02:36 AM
I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.
|
best local open-weight model this week
|
|
10-19-2026, 02:36 AM
I think the bottleneck is somewhere else. The reported numbers can look compelling, but in ordinary usage I didn't see the same benefit.
10-19-2026, 03:13 AM
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at batch size. Once you know the plain path works, then add the faster path back in piece by piece.
10-19-2026, 04:58 AM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
|
|
« Next Oldest | Next Newest »
|