multimodal local stack that feels real

[visionforge]

Appreciate the detail. The pattern around long context has been pretty similar for me. The biggest change for me was simplifying the stack instead of adding one more optimization layer.

[audiopath66]

Can you fill in a bit more context? Do you see the same thing with a smaller batch or shorter prompt?

[oxideworks59]

What exact setup are you running? Are you testing this on 7900 XTX or something else?

[paperrunner]

I tested this tonight. On GB200 with TensorRT-LLM, I saw basically the same behavior. I expected the model choice to matter more than it did.

[forgemixer]

Did a small comparison this afternoon. On B200 with SGLang, I saw basically the same behavior.

A couple questions before I guess too hard. Is this local-only or are you routing anything externally?

[latentpeak22]

Did a small comparison this afternoon. On B200 with SGLang, I saw basically the same behavior.