Found what the isssue was.
Even thought the docs say :
Note : The email and email_verified claims will soon be gated by the user:read:email scope that must be included on the authorization request.
Looks like they pushed the update without updating the doc
So if anyone else has this problem and finds this post you need to add ‘user:read:email’ to you scope parameters