You might need to refresh your extensions settings/configuration after changing it twitch side.
Or:
In chrome hit f12 (inspector) go to applications (tab) and then from there you should be able to clear “local storage”
That’ll reset the board as it were