what are you all running this week: worth it?

[ggufwire22]

Did a bit of testing and thought I'd post the result here.

After a few runs on 4090, I ended up with decent performance, but the setup only really made sense once I adjusted around tool calling.

Happy to post more details if anyone wants them.

[tensorkite]

Appreciate the detail. I ended up in about the same place using llama.cpp.