10-15-2026, 06:26 AM
A couple things I'd check first. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at KV cache pressure.
curious and caffeinated
|
model fallback rules that work
|
|
« Next Oldest | Next Newest »
|