Hmm I definitely see some overlap of ideas there, but I think my usecase is still slightly different. The idea here is that any given viewer could have a different experience of the stream based on how they were interacting with the stream. For example if the stream video was mapped to a 3D cube, any given user could rotate the cube differently, independent of action by the streamer.
So said differently, no local data sending besides a stream.
Also looking at the rules I now see that you can’t use iframes (makes sense).