+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: LLM Models (https://www.datasculpting.ai/inference/forumdisplay.php?fid=12)
+--- Forum: Open Weight (https://www.datasculpting.ai/inference/forumdisplay.php?fid=49)
+---- Forum: Local (https://www.datasculpting.ai/inference/forumdisplay.php?fid=51)
+---- Thread: setup notes worth sharing (/showthread.php?tid=682)
setup notes worth sharing - mangoquill - 10-03-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between LM Studio and TensorRT-LLM for Mistral. The interesting difference for me has been tool calling.
Interested in tradeoffs more than fan loyalty.
I care more about stability than squeezing the last possible tokens/sec out of it.