email in python3 doesn't necessarily work with binary payloads.  (Obviously here you've found the opposite problem, but it is in methods that aren't used by the package itself.)  There aren't any tests of binary payloads in the test suite.  Ultimately this needs to be fixed one way or another, but I'm not sure when it is going to happen.