List of user_Id of every viewer of specific streamer

Yes, you do exactly what you are doing. And handle the rate limit issue. You only need to get the user_id of a name you don’t have in your cache.