Do I need to include my query string parameters with after?

After testing.

You need to include the same parameters

So

https://api.twitch.tv/helix/streams?language=en&after=token

Is correct

but

https://api.twitch.tv/helix/streams?after=TOKEN

is not