Modding the bot did the trick. Thanks for the pointer.
Is there a way to check whether the bot is a mod or not using the IRC or Twitch protocols? That way I could trigger the delay workaround if for whatever reason the bot is not a mod.
EDIT: Never mind. I just discovered an API for checking mods.