Then keep within the rate limit.
This tool I wrote
https://barrycarlyon.github.io/twitch_misc/examples/browse_categories/
and converted for Server use, works quite well, but generally, I don’t wander north of 20 games anyway.
You can always set a max number of threads to run and employ logic to stay within the rate limiting. And get the data you need.
Since as you finish getting pages for game x, that’ll free up more threads for other games.
Additionally depending on why you are doing this, you probably can stop after 50 pages as the long tail is less statistically significant than the short tail.