Can you access the broadcaster's video stream?

That is one valid route.

You could logically connect to the stream post injest and grab from there. But it’s easier to do it OBS/XSplit (caster) side