09-01-2026, 05:06 AM
Spent some time on this today and wanted to compare notes.
I've gone back and forth between llama.cpp and LM Studio for Mistral. The interesting difference for me has been NVFP4.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it.
I've gone back and forth between llama.cpp and LM Studio for Mistral. The interesting difference for me has been NVFP4.
Trying to avoid rebuilding the whole thing twice.
I care more about stability than squeezing the last possible tokens/sec out of it.
routing beats arguing over one perfect model