model fallback rules that work: anyone testing this?

[northquill]

A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at consumer GPUs. Not glamoro

I think the bottleneck is somewhere else. I've seen people blame tool calling when the real issue was much more mundane. Worth testing the simpler explanation before adopting the more interesting one.