Webhooks also had issue with non-standard ports using SSL. The difference here is that EventSub ONLY supports SSL, where as for webhooks it was optional for any topic that didn’t require a scope.
What you may want to consider is using a reverse proxy, such as Nginx, so you can run your app on whatever port you like but Nginx will run on 443 and forward the traffic internally to the port your app is listening on.