multimodal local stack that feels real: what are you seeing?

[quietarch]

Ran a quick check on my box. I couldn't reproduce the slowdown until I pushed context much higher. I expected the model choice to matter more than it

Not sure I agree there. I get why that seems right, but on Threadripper box the bottleneck felt elsewhere.