You can have users go through the OAuth process, but keep in mind that only panel extensions can open links, so if your extension is a Video Overlay, or a Video Component you’ll have no way to send viewers to the auth link, you would need them to copy/paste the string in a new tab which isn’t a good user experience.
Unless you specifically need scopes from the viewer, you should use a backend server and an App Access Token to make API requests.