The Twitch API allows you to check whether a channel is live through their “stream” endpoint which can be explained more in-depth here https://dev.twitch.tv/docs/v5/reference/streams
Simply make a GET request to this endpoint client side using javascript and when the stream is live embed the video player.