+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Harnesses, Agents & Orchestration (https://www.datasculpting.ai/inference/forumdisplay.php?fid=11)
+--- Forum: MCP / APIs / Tool Calling (https://www.datasculpting.ai/inference/forumdisplay.php?fid=46)
+--- Thread: frankenmerges anyone kept using (/showthread.php?tid=1466)
frankenmerges anyone kept using - sparrowcraft - 10-18-2026
Spent some time on this today and wanted to compare notes.
I've gone back and forth between llama.cpp and TensorRT-LLM for FLUX. The interesting difference for me has been tail latency.
Interested in tradeoffs more than fan loyalty.