There seems to be an issue in some case, at least bards that once a creature is charmed and the charm either breaks or you click it off, that you can not attack it or your bot cannot attack it.
I'm sure this isn't a problem with your personal coding but I figured I would let you know.