10-09-2026, 09:04 PM
I'd approach it in a boring order. Start by verifying the driver/runtime combo, then test with a smaller prompt, then look at prefill/decode split. Not glamorous advice, but repeatable baselines save a lot of time.
|
non-AI thing you built recently
|
|
« Next Oldest | Next Newest »
|