Make a request to the Get Streams endpoint https://dev.twitch.tv/docs/api/reference#get-streams
If a stream object is returned then the channel is live, in which case your can embed the stream https://dev.twitch.tv/docs/embed
If an empty data array is returned it means the stream is offline, in which case your site can just not embed anything.