This is likely a shadowban for going over the whispers limit. This can also happen if users report the bot as spam multiple times. I would recommend filing a ticket on https://help.twitch.tv to be considered for bot whitelisting. That will raise your rate limit (but not remove it).