A possible answer to "why is this encoding at all" was probably to make it easier to transition code from python 2.x where strings were usually ascii and it would make no difference in output if encoded in utf-8.  The 2-to-3 fixer was good at handling name changes but not bytes/text issues.  That is just a guess at what the developer may have been thinking.