09-04-2026, 11:15 AM
Quote:What worked for me was pretty simple. Before rebuilding anything, I'd test one clean baseline with Gemma and compare from there.
I'd approach it in a boring order. If you're on TensorRT-LLM, I'd confirm the version first and then reduce variables until the behavior is obvious. Not glamorous advice, but repeatable baselines save a lot of time.
If you post your exact settings, people here can probably narrow it down pretty fast.