I mean, this is only really awkward if you think they're alive and conscious, and if you think so you're clearly already comfortable being a slaver. If it's just a little software puppet, that's a different story - the puppets are supposed to lay still once the hands animating them leave.
A less silly way to do this might be using some kind of long term consequences calculation as guard rails, but that's tough because consequences are often going to be not directly related to the context window, or simply unrecorded by the machine like annoying collaborators or communities.
A less silly way to do this might be using some kind of long term consequences calculation as guard rails, but that's tough because consequences are often going to be not directly related to the context window, or simply unrecorded by the machine like annoying collaborators or communities.