This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author Iago-lito -
Recipients Iago-lito -, ezio.melotti, vstinner
Date 2018-01-02.16:07:21
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1514909242.99.0.467229070634.issue32483@psf.upfronthosting.co.za>
In-reply-to
Content
Consistent with [PEP 3131](https://www.python.org/dev/peps/pep-3131/) and NFKC normalization of identifiers, these two last lines yield an error, since `𝜏` (U+1D70F) is automatically converted to `τ` (U+03C4).

    class Base(object):
        def __init__(self):
            self.𝜏 = 5 # defined with U+1D70F

    a = Base()
    print(a.𝜏)     # 5             # (U+1D70F) expected and intuitive
    print(a.τ)     # 5 as well     # (U+03C4)  normalized version, okay.
    d = a.__dict__ # {'τ':  5}     # (U+03C4)  still normalized version
    print(d['τ'])  # 5             # (U+03C4)  consistent with normalization
    assert hasattr(a, 'τ')         # (U+03C4)  consistent with normalization
    # But if I want to retrieve it the way I entered it because I can type (U+1D70F)
    print(d['𝜏'])  # KeyError: '𝜏' # (U+1D70F) counterintuitive
    assert hasattr(a, '𝜏') # Fails # (U+1D70F) counterintuitive

I've described and undestood the problem in [this post](https://stackoverflow.com/questions/48063082/).

Nothing is unconsistent here. However, I am worried that:

- this behaviour might be counterintuitive and misleading, especially if it occurs that the character user can easily enter for some reason (e.g. U+1D70F) is not equivalent to its NFKC normalization (e.g. U+03C4)

- this behaviours makes it more difficult to enjoy python's reflective `__dict__`, `hasattr` and `getattr` features in this particular case.

Maybe it is user's responsibility to be aware of this limitation, and to keep considering utf-8 coding a bad practice. In this case, maybe this particular reflective limitation could be made explicit in PEP 3131.

Or maybe it is python's responsibility to ensure intuitive and consistent behaviour even in tricky-unicode-cases. So reflective features like `__dict__.__getitem__`, `hasattr` or `getattr` would NFKC-convert their arguments before searching just like `a.𝜏` does, so that:

    getattr(a, '𝜏') is gettatr(a, 'τ')

always yields True.

I actually have no idea of the philosophy to stick to. And the only purpose of this post is to inform the community about this particular, low-priority case.

Thank you for supporting Python anyway, cheers for your patience.. and happy 2018 to everyone :)


--
Iago-lito
History
Date User Action Args
2018-01-02 16:07:23Iago-lito -setrecipients: + Iago-lito -, vstinner, ezio.melotti
2018-01-02 16:07:22Iago-lito -setmessageid: <1514909242.99.0.467229070634.issue32483@psf.upfronthosting.co.za>
2018-01-02 16:07:22Iago-lito -linkissue32483 messages
2018-01-02 16:07:21Iago-lito -create