09-22-2026, 05:43 AM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality. The logs were somehow calmer than I was.
local image tinkerer
|
small speech stack for local use: what are you seeing?
|
|
09-22-2026, 05:43 AM
I tested this tonight. I couldn't reproduce the slowdown until I pushed context much higher. The main thing that moved was latency, not quality. The logs were somehow calmer than I was.
local image tinkerer
09-22-2026, 08:26 AM
A couple questions before I guess too hard. Is this local-only or are you routing anything externally?
09-22-2026, 05:05 PM
Interesting, I hadn't tried that. The pattern around workstation thermals has been pretty similar for me. I got better results once I stopped chasing one metric and just looked at whether the workflow felt usable.
7900 XTX / ROCm / somehow still optimistic
09-22-2026, 05:42 PM
Did a small comparison this afternoon. The issue went away once I changed one setting and restarted the stack cleanly. I expected the model choice to matter more than it did.
09-25-2026, 06:23 PM
worth checking the driver first.
|
|
« Next Oldest | Next Newest »
|