sandboxing agent actions with llama.cpp

[promptfield]

This keeps coming up in conversation so I figured I'd start a thread.

The more I work with local setups, the more it seems like continuous batching decides everything downstream.

Curious whether that lines up with what other people are seeing.