➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author serhiy.storchaka
Recipients Devin Jeanpierre, barry, eric.araujo, eric.snow, mark.dickinson, martin.panter, mbussonn, meador.inge, michael.foord, petri.lehtinen, serhiy.storchaka, takluyver, terry.reedy, trent, vstinner
Date 2018-05-18.07:59:47
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1526630387.55.0.682650639539.issue12486@psf.upfronthosting.co.za>
In-reply-to
Content 
My concern is that we will have two functions with non-similar names (tokenize() and generate_tokens()) that does virtually the same, but accept different types of input (bytes or str), and the single function untokenize() that produces different type of result depending on the value of input. This doesn't look like a good design to me.
History
Date User Action Args
2018-05-18 07:59:47serhiy.storchakasetrecipients: + serhiy.storchaka, barry, terry.reedy, mark.dickinson, vstinner, Devin Jeanpierre, trent, eric.araujo, michael.foord, meador.inge, eric.snow, takluyver, petri.lehtinen, martin.panter, mbussonn
2018-05-18 07:59:47serhiy.storchakasetmessageid: <1526630387.55.0.682650639539.issue12486@psf.upfronthosting.co.za>
2018-05-18 07:59:47serhiy.storchakalinkissue12486 messages
2018-05-18 07:59:47serhiy.storchakacreate