09-01-2026, 09:11 PM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between LM Studio and SGLang for Llama. The interesting difference for me has been NVFP4.
Trying to avoid rebuilding the whole thing twice.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.
I've gone back and forth between LM Studio and SGLang for Llama. The interesting difference for me has been NVFP4.
Trying to avoid rebuilding the whole thing twice.
For context, I'm not chasing leaderboard numbers. I mostly want the system to feel consistent day to day.