hybrid retrieval results on GB200

[bytesupply76]

Did a bit of testing and thought I'd post the result here.

I tried this with Kimi using TensorRT-LLM on mini PC. The headline result was better than I expected, but structured output still ended up being the limiting factor.

Happy to post more details if anyone wants them.

[cobaltworks25]

Did a bit of testing and thought I'd post the result here.

A couple questions before I guess too hard. Is this local-only or are you routing anything externally? Turns out 'just one more test' was a lie.

[tinycontext]

A couple things I'd check first. If you're on Ollama, I'd confirm the version first and then reduce variables until the behavior is obvious. Once you know the plain path works, then add the faster path back in piece by piece.

I'm happy to test one more variant if you want a second data point.