Things only meant for the Broadcaster’s eyes should go into the Live Config View, in my opinion. That obviously doesn’t have the video beneath it, so it may not be what you’re looking for.
In the end, depending on what you want to achieve: Yes, a seperate Webapp may be more suitable.
To answer your question: No, there is not a way to “hide” an Extension fully from viewers.