setup notes worth sharing

[mangoquill]

Spent some time on this today and wanted to compare notes.

I've gone back and forth between LM Studio and TensorRT-LLM for Mistral. The interesting difference for me has been tool calling.

Interested in tradeoffs more than fan loyalty.

I care more about stability than squeezing the last possible tokens/sec out of it.