classification
Title: sys.executable default and altinstall
Type: behavior Stage: test needed
Components: Interpreter Core Versions: Python 3.5
process
Status: open Resolution:
Dependencies: Superseder:
Assigned To: Nosy List: Arfrever, allan, barry, eric.araujo, loewis, ncoghlan, piotr.dobrogost, r.david.murray, stephane
Priority: normal Keywords: easy

Created on 2011-01-05 12:51 by allan, last changed 2014-03-18 04:36 by eric.araujo.

Messages (9)
msg125420 - (view) Author: Allan McRae (allan) Date: 2011-01-05 12:51
when sys.executable is run with a modified argv[0] such as:

> sh -c "exec -a '' /usr/bin/python2.7 -c 'import sys; print(sys.executable)'"

it returns some a hardcoded value.   In this case, it returns /usr/bin/python.   This value is likely wrong when python is installed with "make altinstall".

A possible solution is to modify the "progname" variable in Python/pythonrun.c to include the version in it so that the hardcoded return value is the most version specific binary.  I.e.

static char *progname = "python2.7";
msg125444 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2011-01-05 18:14
Another alternative might be to return "None" ("refuse the temptation to guess").  But, given the long standing nature of the current guessing, having it return the specific version string may indeed make sense.
msg125458 - (view) Author: Barry A. Warsaw (barry) * (Python committer) Date: 2011-01-05 19:30
For Python < 3.2, I think adding the version number alone makes sense.  Can you think of any situations where the trailing digits could break something?

For Python 3.2 I'd suggest also adding the build flags to sys.executable.  If you want the most specific binary, that would make the most sense.
msg125469 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2011-01-05 21:02
Well, the digits are there if they are there in the name when that's actually what is in argv[0], so as long as that's the name the binary is actually installed under I don't think it will break anything.  I presume the same applies to the abi flags but haven't checked.

That said, I don't know for sure that progname is the right thing to change; I haven't looked through the code to see how sys.executable is generated or if there is anything else GetPythonName is used for.

Hmm.  I suppose there could be an issue if Python is invoked through a wrapper...I know Gentoo does that, so I've added Arfrever to nosy to see if he has an opinion.
msg125475 - (view) Author: Arfrever Frehtes Taifersar Arahesis (Arfrever) * (Python triager) Date: 2011-01-05 21:58
I rather doubt that there will be any problem with Python invoked through a wrapper.
Gentoo's python-wrapper isn't used when target executable (e.g. /usr/bin/python3.1) is directly called.  A side effect of python-wrapper is that sys.executable is the target executable:
$ readlink /usr/bin/python
python-wrapper
$ /usr/bin/python -c 'import sys; print(sys.executable)'
/usr/bin/python3.1
$ /usr/bin/python-wrapper -c 'import sys; print(sys.executable)'
/usr/bin/python3.1
$ sh -c "exec -a '' /usr/bin/python -c 'import sys; print(sys.executable)'"
/usr/bin/python3.1
$ sh -c "exec -a '' /usr/bin/python3.1 -c 'import sys; print(sys.executable)'"
/usr/bin/python

If there is a patch, then I can test it.
msg125598 - (view) Author: Martin v. Löwis (loewis) * (Python committer) Date: 2011-01-06 22:36
I fail to see the bug. Garbage in, garbage out. AFAIU, returning /usr/bin/python2.7 still might be the wrong answer.
msg125611 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2011-01-07 01:13
I agree that not guessing would be better.  But as long as we *are* guessing, it seems to me that /usr/bin/python2.7 would be less wrong than /usr/bin/python, for almost all modern unix systems.
msg125627 - (view) Author: Martin v. Löwis (loewis) * (Python committer) Date: 2011-01-07 06:58
> I agree that not guessing would be better.

Well, on Linux, readlink("/proc/self/exe") would be better than
guessing.
msg213132 - (view) Author: Piotr Dobrogost (piotr.dobrogost) Date: 2014-03-11 09:28
> Garbage in, garbage out.

In this case – exec -a '' – yes, but in general not so – see "Mismatch between sys.executable and sys.version in Python" question at SO (http://stackoverflow.com/q/22236727/95735).

As to not guessing Victor STINNER in comment http://bugs.python.org/issue7774#msg100849 wrote this:

"
There are different methods to get the real program name, but no one is portable. As flox wrote, we can "do a best effort to provide a valid sys.executable". Extract of stackoverflow link:

 * Mac OS X: _NSGetExecutablePath() (man 3 dyld)
 * Linux: readlink /proc/self/exe
 * Solaris: getexecname()
 * FreeBSD: sysctl CTL_KERN KERN_PROC KERN_PROC_PATHNAME -1
 * BSD with procfs: readlink /proc/curproc/file
 * Windows: GetModuleFileName() with hModule = NULL
"
History
Date User Action Args
2014-03-18 04:36:21eric.araujosetversions: + Python 3.5, - Python 3.1, Python 2.7, Python 3.2
2014-03-11 09:28:54piotr.dobrogostsetnosy: + piotr.dobrogost
messages: + msg213132
2011-01-09 01:17:02eric.araujosetnosy: + eric.araujo
2011-01-07 06:58:39loewissetnosy: loewis, barry, ncoghlan, Arfrever, r.david.murray, allan, stephane
messages: + msg125627
2011-01-07 01:13:34r.david.murraysetnosy: loewis, barry, ncoghlan, Arfrever, r.david.murray, allan, stephane
messages: + msg125611
2011-01-06 22:36:36loewissetnosy: + loewis
messages: + msg125598
2011-01-06 12:25:22stephanesetnosy: + stephane
2011-01-05 21:58:25Arfreversetnosy: barry, ncoghlan, Arfrever, r.david.murray, allan
messages: + msg125475
2011-01-05 21:02:37r.david.murraysetnosy: + Arfrever
messages: + msg125469
2011-01-05 19:30:12barrysetnosy: barry, ncoghlan, r.david.murray, allan
messages: + msg125458
2011-01-05 18:31:26pitrousetnosy: + barry
2011-01-05 18:20:58r.david.murraysetnosy: + ncoghlan
2011-01-05 18:14:37r.david.murraysettype: behavior
versions: - Python 2.6, Python 2.5, Python 3.3
keywords: + easy
nosy: + r.david.murray

messages: + msg125444
stage: test needed
2011-01-05 12:51:33allancreate