what made local AI click for you

[cacheplane98]

That matches what I was seeing. I don't think your conclusion is far off.

[ggufwire22]

That matches what I was seeing. I don't think your conclusion is far off.

Maybe, but I had the opposite result. I've seen people blame reranking when the real issue was much more mundane. Not saying you're wrong, just that I wouldn't lock that in as the lesson yet.

[tensorkite]

I'd start with the simpler stack.

[mlxgarden]

That matches what I was seeing. That matches what I saw on Threadripper box.

[llm_wren]

I tested this tonight. On 5090 with SGLang, I saw basically the same behavior. The main thing that moved was latency, not quality.