Whispers are sent differently from the twitch servers. They are sent as WHISPER commands insetad of privade messages.