I just performed a number of channel follows requests with limit of 100. Got 100 back everytime with the exception of the last request which topped off the follower count. Additionally, the follower count had changed in the time I was fetching all of the followers due to new followers. Perhaps one of these is causing your problem?