Depending on what events you need, a chat connection is a popular option as it provides a lot of functionality that many apps require as well as moderator actions. There are still some technical limits to the number of channels you can join per connection, but there’s not strict Twitch limit on how many connections you can have (beyond don’t try to start a malicious number of connections).
Alternatively you could look in to EventSub https://dev.twitch.tv/docs/eventsub/eventsub-subscription-types which has channel ban and unban topics. That’d allow you to not need any established connections, just a web server to listen for incoming notifications from Twitch when those events occur.