That would be the problem
If you turn on raw logging. You will get an error notice along the lines of:
Your settings prevent you sending this whisper.
Essentially no, Bot’s just can’t (reliably) whisper. And should avoid using this product.
There is no “fix”
The only advice I/we can really give you is “don’t use Whispers in your bot” you will have deliverbility issues