This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Title: 2.7: wrong user site directory on Linux
Type: behavior Stage: resolved
Components: Library (Lib) Versions: Python 2.7
Status: closed Resolution: fixed
Dependencies: Superseder:
Assigned To: tarek Nosy List: eric.araujo, ronaldoussoren, srid, tarek
Priority: high Keywords:

Created on 2010-05-18 21:57 by srid, last changed 2022-04-11 14:57 by admin. This issue is now closed.

Messages (10)
msg106009 - (view) Author: Sridhar Ratnakumar (srid) Date: 2010-05-18 21:57
sridharr@triple:~$ /opt/ActivePython-2.7/bin/python -c "import sys; print sys.path; import cmdln"
['', '/opt/ActivePython-2.7/lib/', '/opt/ActivePython-2.7/lib/python2.7', '/opt/ActivePython-2.7/lib/python2.7/plat-linux2', '/opt/ActivePython-2.7/lib/python2.7/lib-tk', '/opt/ActivePython-2.7/lib/python2.7/lib-old', '/opt/ActivePython-2.7/lib/python2.7/lib-dynload', '/home/sridharr/.local/lib/python/2.7/site-packages', '/opt/ActivePython-2.7/lib/python2.7/site-packages']
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: No module named cmdln
sridharr@triple:~$ file /home/sridharr/.local/lib/python2.7/site-packages/ 
/home/sridharr/.local/lib/python2.7/site-packages/ a python script text executable

On OSX, I don't even see a ~/.local directory!

python2.7 -c "import sys; print sys.path"
['', '/Library/Frameworks/Python.framework/Versions/2.7/lib/', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-darwin', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac/lib-scriptpackages', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-tk', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-old', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-dynload', '/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages']

Works as expected on Windows, though.
msg106044 - (view) Author: Tarek Ziadé (tarek) * (Python committer) Date: 2010-05-19 11:33
Are you sure you didn't deactivate use site ? (by turning site.ENABLE_USER_SITE off)

Please check its value:

  >>> import site
  >>> site.ENABLE_USER_SITE 

Pathes look fine on my Mac : 

Python 2.7b2+ (trunk:81228, May 16 2010, 14:42:34) 
[GCC 4.0.1 (Apple Inc. build 5490)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.path
['', '/usr/local/lib/python2.7/site-packages/pip-0.6.1-py2.7.egg', '/usr/local/lib/python2.7/site-packages/distribute-0.6.11dev-py2.7.egg', '/usr/local/lib/', '/MacDev/', '/MacDev/', '/MacDev/', '/MacDev/', '/MacDev/', '/MacDev/', '/MacDev/', '/Users/tarek/.local/lib/python/2.7/site-packages', '/usr/local/lib/python2.7/site-packages']

If you still have the issue, you need to trace python load in, where all the paths are added, by printing them out for example, and using the -v flag
msg106057 - (view) Author: Ronald Oussoren (ronaldoussoren) * (Python committer) Date: 2010-05-19 12:51
The --user directory for framework installs of python on OSX has changed from a subdirectory of ~/.local to a subdirectory ~/Library. As described in the NEWS file:

- Issue #8084: PEP 370 now conforms to system conventions for framework
  builds on MacOS X. That is, "python install --user" will install
  into "~/Library/Python/2.7" instead of "~/.local".

In python 2.6 both ~/.local and ~/Library/Python were added to sys path and that's confusing. As ~/.local does not conform to the filesystem layout conventions on OSX the --user directory now always refers to ~/Library/Python.

For classic unix installs --user still uses the unix conventions. I'm not 100% sure that that is the right choice.

In other words: works as designed.
msg106106 - (view) Author: Sridhar Ratnakumar (srid) Date: 2010-05-19 21:50
@Ronald: Ah, I see. So on Mac, Python 2.7 (with default site configuration) will not pickup packages installed in ~/.local, correct? It will, from now onwards, only consider ~/Library/Package as the user site directory? I ask because I just want to double check before modifying PyPM (which has ~/.local hardcoded in the client) to support this change.

@Tarek: I have user site enabled; didn't change anything .. just the default settings:
$ /tmp/apy27/bin/python -m site
sys.path = [
USER_BASE: '/home/sridharr/.local' (exists)
USER_SITE: '/home/sridharr/.local/lib/python/2.7/site-packages' (exists)


That is strange user site location - "python/2.7/site-packages" really? Shouldn't it be "python2.7/site-packages"?
msg106108 - (view) Author: Sridhar Ratnakumar (srid) Date: 2010-05-19 21:58
On further analysis:

$ /tmp/apy27/bin/python -c "from sysconfig import get_path; print get_path('purelib', 'posix_user')"


    'posix_user': {
        'stdlib': '{userbase}/lib/python/{py_version_short}',
        'platstdlib': '{userbase}/lib/python/{py_version_short}',
        'purelib': '{userbase}/lib/python/{py_version_short}/site-packages',
        'platlib': '{userbase}/lib/python/{py_version_short}/site-packages',

Ah, there is the bug!
msg106109 - (view) Author: Tarek Ziadé (tarek) * (Python committer) Date: 2010-05-19 21:59
"python/2.7/site-packages" is a typo in sysconfig, it should be "python2.7/site-packages" you are right.

Fixing it..
msg106110 - (view) Author: Tarek Ziadé (tarek) * (Python committer) Date: 2010-05-19 22:28
Fixed in r81371, r81372


I let you close the issue once you are through with the rest of the talk.
msg106133 - (view) Author: Ronald Oussoren (ronaldoussoren) * (Python committer) Date: 2010-05-20 04:58
Shridar: that is correct a framework install will not look in ~/.local, but only in ~/Library/Python/2.7  (there is an install scheme in distutils that describes the exact layout).

Technically the name "Python" subdirectory is sysconfig.get_config_var("PYTHONFRAMEWORK"), to ensure that frameworks with different values for --with-framework-name will use different subdirectories.
msg106187 - (view) Author: Sridhar Ratnakumar (srid) Date: 2010-05-20 20:36

> there is an install scheme in distutils that describes the exact layout

I figured that this is now exposed via the `sysconfig` module. There is also an old install scheme in `distutils.command.install`, but it seems to be outdated and is only applicable for 2.6.

My understanding is that, installers such as PyPM should use the scheme in distutils.command.install on 2.6 and the new sysconfig scheme for 2.7+.

Please feel free to close this issue (I can do it, but do not have the privileges to set the resolution field.)
msg115050 - (view) Author: Éric Araujo (eric.araujo) * (Python committer) Date: 2010-08-27 01:21
Fixed in the distutils2 backport in 7f0148944e28 (not pushed yet due to SSH problem with Bitbucket).
Date User Action Args
2022-04-11 14:57:01adminsetgithub: 53005
2010-08-27 01:21:46eric.araujosetresolution: not a bug -> fixed

messages: + msg115050
nosy: + eric.araujo
2010-05-21 01:58:20r.david.murraysetstatus: open -> closed
resolution: not a bug
stage: resolved
2010-05-20 20:36:07sridsetmessages: + msg106187
2010-05-20 04:58:36ronaldoussorensetmessages: + msg106133
2010-05-19 22:28:18tareksetmessages: + msg106110
2010-05-19 21:59:35tareksetmessages: + msg106109
2010-05-19 21:58:16sridsetmessages: + msg106108
2010-05-19 21:50:43sridsetmessages: + msg106106
title: 2.7: wrong user site directory on Linux; totally missing on OSX -> 2.7: wrong user site directory on Linux
2010-05-19 12:51:53ronaldoussorensetmessages: + msg106057
2010-05-19 11:33:22tareksetmessages: + msg106044
2010-05-19 11:15:12pitrousetpriority: normal -> high
assignee: tarek

nosy: + tarek, ronaldoussoren
2010-05-18 21:57:43sridcreate