Add gettext.pgettext() and variants support #46756

genepi · 2008-03-29T02:10:24Z

BPO	2504
Nosy	@loewis, @Cito, @merwok, @mitar, @nh2, @nphilipp, @berkerpeksag, @serhiy-storchaka, @ztane, @csabella, @eli-schwartz
PRs	bpo-2504: Add pgettext() and variants to gettext #7253
Files	gettext-pgettext.patch: Patch for gettext module to add pgettext and variants pgettext-3.2.diff

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2018-11-07.14:32:50.869>
created_at = <Date 2008-03-29.02:10:23.548>
labels = ['3.8', 'type-feature', 'library']
title = 'Add gettext.pgettext() and variants support'
updated_at = <Date 2019-11-24.05:01:50.216>
user = 'https://bugs.python.org/genepi'

bugs.python.org fields:

activity = <Date 2019-11-24.05:01:50.216>
actor = 'eschwartz'
assignee = 'none'
closed = True
closed_date = <Date 2018-11-07.14:32:50.869>
closer = 'serhiy.storchaka'
components = ['Library (Lib)']
creation = <Date 2008-03-29.02:10:23.548>
creator = 'genepi'
dependencies = []
files = ['10036', '19822']
hgrepos = []
issue_num = 2504
keywords = ['patch', 'needs review']
message_count = 33.0
messages = ['64675', '64685', '65526', '79609', '79610', '90338', '90339', '91472', '92796', '97788', '105126', '106121', '106132', '106709', '107560', '122439', '122446', '122482', '202189', '230537', '234853', '277652', '302801', '306594', '306600', '317139', '317300', '318206', '318261', '318282', '328643', '329417', '357389']
nosy_count = 30.0
nosy_names = ['loewis', 'cito', 'bronger', 'wichert', 'genepi', 'franz_glasner', 'eric.araujo', 'Felix Schwarz', 'dwayne', 'sascha_silbe', 'AndrewZiem', 'dns', 'mitar', 'bernie', 'nh2', 'clouserw', 'Flimm', 'olivier-berten', 'nils', 'bersace', 'berker.peksag', 'serhiy.storchaka', 'ztane', 'nhooey', 'Tristan.Fisher', 'Hanno.Zulla', 'Leonid Suprun', 'cheryl.sabella', 'Jonathan Schoonhoven', 'eschwartz']
pr_nums = ['7253']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'enhancement'
url = 'https://bugs.python.org/issue2504'
versions = ['Python 3.8']

genepi · 2008-03-29T02:10:23Z

Please add support for pgettext(msgctxt, msgid) and variants (dpgettext,
dcpgettext...) in the gettext module.

I will not rephrase the justification for these functions and why
contexts are essential for good localization:
http://www.gnu.org/software/gettext/manual/gettext.html#Contexts

loewis · 2008-03-29T08:38:24Z

Would you like to work on a patch?

franzglasner · 2008-04-15T20:17:15Z

I have written a patch against the current Python trunk's gettext to
add support for pgettext and friends (upgettext, npgettext, unpgettext,
...).

I have also changed Tools/i18n/msgfmt.py to recognize the "msgctxt" keyword.
Some new unittests for dgettext and lgettext and variants are also included.

If the patch will be accepted then someone should drop a message to the
maintainers of GNU gettext to add the new functions as default keywords
for xgettext. Right now you have to call xgettext with
"--keyword=pgettext:1c,2" to extract messages with context.

Tools/i18n/pygettext.py does currently not handle context variants.

vstinner · 2009-01-11T18:57:45Z

I don't see any change in Modules/_localemodule.c: you reimplemented
pgettext() in pure Python. Why no reusing existing pgettext() function
(at least when it's present)?

loewis · 2009-01-11T19:00:36Z

The gettext module is intentionally written in pure Python; it should
stay that way. Whether or not the _locale module should also grow
support for pgettext is a different issue.

dns · 2009-07-09T18:14:22Z

I came across this ticket while looking for alternatives to Python's
gettext, since I need msgctx support. It seems a patch was supplied for
this a while back. I have never contributed to Python, and am not
familiar with your release process, but is there anything preventing its
inclusion? It would be very convenient to have this in a release version.

loewis · 2009-07-09T18:31:24Z

Only my lack of time prevents inclusion.

mitar · 2009-08-11T09:56:20Z

I would just like to add that I am also looking forwards to this feature.

nh2 · 2009-09-17T21:19:32Z

Me too. This makes developing applications with good localizations in
Python really difficult.

Flimm · 2010-01-14T21:18:26Z

Same here.

olivier-berten · 2010-05-06T06:49:23Z

Pleeeeeeeaaaaaaaase ;-)

Bernie · 2010-05-20T00:07:17Z

While we're waiting for this patch to be upstreamed, what's the best way to emulate this functionality with the current gettext module?

I'm looking at the patch and it seems that code similar to this might work?

  def pgettext(ctx, msg):
     return gettext(ctx + "\x04" + msg)

clouserw · 2010-05-20T04:47:21Z

Yes. You can see an in-production implementation at http://github.com/clouserw/tower/blob/master/tower/__init__.py#L51 (I'm overriding ugettext to support an optional context).

wichert · 2010-05-29T06:39:49Z

Martin, is there anything we can do to help get this merged? I can really use this as well.

My background here is that currently the complete zope i18n support abuses message ids as a workaround, and the result works but is very painful for translators since the original string is not immediately visible for them.

merwok · 2010-06-11T16:44:10Z

The patch needs to be updated for the 3.x trunk (py3k branch), since the last 2.x version is already rc.

Everyone, thanks for expressing interest for the development of Python, but posting “me too” messages does not further the discussion, and actually takes time from already busy people. Use cases, patches, reviews and the occasional bump (one is enough) are helpful. :)

merwok · 2010-11-26T05:28:48Z

I have ported the patch to py3k, without tests errors but with test failures. What is left to do:

Carefully assess bytes/str issues. Decide to change the tests or the code.
Re-read over the new docs.
Exercise the updated msgfmt.py tool, which has no tests.
Add support in pygettext.py.

David, Mitar, nh2, David D., Olivier, Bernie, Wil, Wichert: Do you want to help with one of those tasks?

wichert · 2010-11-26T09:20:23Z

I can help test changes for python 2.x. The python 3.x ecosystem is at least a year away from becoming interesting for me I'm afraid.

merwok · 2010-11-26T23:13:57Z

New features don’t go into stable branches.

The patch is also reviewable at http://codereview.appspot.com/3340041

nhooey · 2013-11-05T03:13:03Z

Can someone review the patch and consider its inclusion?

wichert · 2014-11-03T14:49:41Z

Bump.

Python 3 is still not on my radar, but I'll happily do a backport for Py2 and drop that on PyPI once this gets resolved.

HannoZulla · 2015-01-27T21:02:13Z

Can we please get pgettext for Python?

ztane · 2016-09-28T19:05:20Z

*wow* isn't this in Python 3 yet (I've been using Zope translationstrings lately so I didn't know that pgettext is still not supported).

serhiy-storchaka · 2017-09-23T19:25:33Z

This looks like a nice feature. Éric, could you please create a PR on GitHub?

I think that new l*gettext functions are not needed. They are rather useless in Python 3 (see bpo-29755).

JonathanSchoonhoven · 2017-11-20T22:30:57Z

Is there anything I can do to help get this into the codebase and out issue purgatory? We're not that far off from the 10 year anniversary of this issue.

merwok · 2017-11-20T23:39:34Z

The patch would need to be applied on top of the current master to make a pull request. Then, the tasks outlined in that message should be addressed:

https://bugs.python.org/issue2504#msg122439

csabella · 2018-05-19T21:48:17Z

Éric,

Was your last comment intended as a todo for yourself or an outline of the steps needed for someone else to move this along (maybe it was a reply to Jonathan Schoonhoven's question)?

If the latter, I'd be happy to try to work on the PR.

Thanks!

merwok · 2018-05-22T15:40:09Z

It was an answer to «Is there anything I can do to help get this into the codebase»

Feel free to take this on! I’ll try to review.

csabella · 2018-05-30T20:17:47Z

I've created a pull request for this based on Éric's patch in 2010. I attempted to incorporate the changes from bpo-29755 into the new functions and tests. I believe these changes take care of items 1 and 2 from msg122439.

I haven't tried to address item 3 in msg122439 yet.

Since this is already a large change, item 4 in msg122439 might be better as its own issue.

serhiy-storchaka · 2018-05-31T06:33:27Z

Do you have a use case for lpgettext() and like?

csabella · 2018-05-31T10:36:25Z

No, I didn't have a use case for the l* functions. I included them just as a result of applying the entire patch from 2010. I also didn't know if further discussion was needed before excluding them.

serhiy-storchaka · 2018-10-27T05:35:05Z

l*gettext() functions have been just deprecated in bpo-33710. Please update the PR and remove new l*gettext() functions.

serhiy-storchaka · 2018-11-07T14:12:24Z

New changeset 637a33b by Serhiy Storchaka (Cheryl Sabella) in branch 'master':
bpo-2504: Add pgettext() and variants to gettext. (GH-7253)
637a33b

eli-schwartz · 2019-11-24T05:01:50Z

Interestingly enough, the final accepted patch (and the 2010 one) also fixes a bug where gettext.install(..., names='ngettext') would incorrectly work, in violation of the documentation.

I think it would also incorrectly install 'gettext', too...

It used to just check if names.__contains__ is a valid attribute, then check if 'foo' in names, so a dumb string "worked" and even matched more things than it should have.

How I discovered this: I fixed a bug in a python project that stopped working on python 3.8, and had a bit of a head-scratch regarding how it ever worked to begin with: linuxmint/cinnamon#8964

genepi mannequin added extension-modules C modules in the Modules dir type-feature A feature request or enhancement labels Mar 29, 2008

franzglasner mannequin added stdlib Python modules in the Lib dir and removed extension-modules C modules in the Modules dir labels Apr 15, 2008

loewis mannequin self-assigned this Apr 15, 2008

merwok added the 3.7 (EOL) end of life label Sep 19, 2017

merwok unassigned loewis Nov 20, 2017

serhiy-storchaka added 3.8 only security fixes and removed 3.7 (EOL) end of life labels Oct 27, 2018

serhiy-storchaka closed this as completed Nov 7, 2018

ezio-melotti transferred this issue from another repository Apr 10, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add gettext.pgettext() and variants support #46756

Add gettext.pgettext() and variants support #46756

genepi mannequin commented Mar 29, 2008

genepi mannequin commented Mar 29, 2008

loewis mannequin commented Mar 29, 2008

franzglasner mannequin commented Apr 15, 2008

vstinner commented Jan 11, 2009

loewis mannequin commented Jan 11, 2009

dns mannequin commented Jul 9, 2009

loewis mannequin commented Jul 9, 2009

mitar mannequin commented Aug 11, 2009

nh2 mannequin commented Sep 17, 2009

Flimm mannequin commented Jan 14, 2010

olivier-berten mannequin commented May 6, 2010

Bernie mannequin commented May 20, 2010

clouserw mannequin commented May 20, 2010

wichert mannequin commented May 29, 2010

merwok commented Jun 11, 2010

merwok commented Nov 26, 2010

wichert mannequin commented Nov 26, 2010

merwok commented Nov 26, 2010

nhooey mannequin commented Nov 5, 2013

wichert mannequin commented Nov 3, 2014

HannoZulla mannequin commented Jan 27, 2015

ztane mannequin commented Sep 28, 2016

serhiy-storchaka commented Sep 23, 2017

JonathanSchoonhoven mannequin commented Nov 20, 2017

merwok commented Nov 20, 2017

csabella commented May 19, 2018

merwok commented May 22, 2018

csabella commented May 30, 2018

serhiy-storchaka commented May 31, 2018

csabella commented May 31, 2018

serhiy-storchaka commented Oct 27, 2018

serhiy-storchaka commented Nov 7, 2018

eli-schwartz mannequin commented Nov 24, 2019

Add gettext.pgettext() and variants support #46756

Add gettext.pgettext() and variants support #46756

Comments

genepi mannequin commented Mar 29, 2008

genepi mannequin commented Mar 29, 2008

loewis mannequin commented Mar 29, 2008

franzglasner mannequin commented Apr 15, 2008

vstinner commented Jan 11, 2009

loewis mannequin commented Jan 11, 2009

dns mannequin commented Jul 9, 2009

loewis mannequin commented Jul 9, 2009

mitar mannequin commented Aug 11, 2009

nh2 mannequin commented Sep 17, 2009

Flimm mannequin commented Jan 14, 2010

olivier-berten mannequin commented May 6, 2010

Bernie mannequin commented May 20, 2010

clouserw mannequin commented May 20, 2010

wichert mannequin commented May 29, 2010

merwok commented Jun 11, 2010

merwok commented Nov 26, 2010

wichert mannequin commented Nov 26, 2010

merwok commented Nov 26, 2010

nhooey mannequin commented Nov 5, 2013

wichert mannequin commented Nov 3, 2014

HannoZulla mannequin commented Jan 27, 2015

ztane mannequin commented Sep 28, 2016

serhiy-storchaka commented Sep 23, 2017

JonathanSchoonhoven mannequin commented Nov 20, 2017

merwok commented Nov 20, 2017

csabella commented May 19, 2018

merwok commented May 22, 2018

csabella commented May 30, 2018

serhiy-storchaka commented May 31, 2018

csabella commented May 31, 2018

serhiy-storchaka commented Oct 27, 2018

serhiy-storchaka commented Nov 7, 2018

eli-schwartz mannequin commented Nov 24, 2019