I think I’ve been having the same issue as well. I think Xanbot is having the issue too as it is randomly missing from channels it should be in.
As a work around for now I’m going to just issue a reconnect if there have been no messages in the past 5 minutes and the stream is on.