This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author Zhang Wenbo
Recipients Zhang Wenbo, archibald, barry, r.david.murray, touilleMan
Date 2017-06-12.07:31:33
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <>
I think I find a case which can reproduct this bug: 
the UnstructuredTokenList has a ValueTerminal which is long enough(its encoded word is longer than policy.maxlen ) and not at the beginning.

For examples, the following subjects can cause this bug:

- 'Re: 我只是一个有那么一点点长的主题而已'
- '回复: 回复:【北京大学-2017年招生信息公告】'

So, the code can not fold a ValueTerminal correctly. 
Seems the method `_fold_as_ew` was designed to do this, but it is missing.
Date User Action Args
2017-06-12 07:31:34Zhang Wenbosetrecipients: + Zhang Wenbo, barry, r.david.murray, touilleMan, archibald
2017-06-12 07:31:34Zhang Wenbosetmessageid: <>
2017-06-12 07:31:34Zhang Wenbolinkissue27240 messages
2017-06-12 07:31:34Zhang Wenbocreate