The Streamer Allowlist limits who can Install an Extension, but does not limit who can interact with an Extension.
So if you was to put streamer xyz on the Allow List, then only they can install it, but anyone going to xyz’s channel can view and interact with it.