+- Inference (https://www.datasculpting.ai/inference)
+-- Forum: Miscellaneous Discussion (https://www.datasculpting.ai/inference/forumdisplay.php?fid=24)
+--- Forum: General (https://www.datasculpting.ai/inference/forumdisplay.php?fid=25)
+--- Thread: what are you all running this week: worth it? (/showthread.php?tid=1222)
what are you all running this week: worth it? - ggufwire22 - 10-14-2026
Did a bit of testing and thought I'd post the result here.
After a few runs on 4090, I ended up with decent performance, but the setup only really made sense once I adjusted around tool calling.
Happy to post more details if anyone wants them.
Re: what are you all running this week: worth it? - tensorkite - 10-17-2026
Appreciate the detail. I ended up in about the same place using llama.cpp.