Unfortunately, there isn’t a way that I am aware of. In the standard there is no requirement for a server to honor the “no-cache” directive in the HTTP request. I don’t work for Twitch, so I can only comment generally, but I would believe that the followers DB gets a ton of hits and takes time to propagate perhaps at times.
There is also the possibility that there is a caching issue that is occurring at this time, something like that happened to TMI for a couple/few weeks (there were 9-30 minute delays in data) and the Twitch Staff resolved that issue.