Created on 2009-02-19 01:39 by pitrou, last changed 2013-01-04 10:01 by christian.heimes.
| Messages (4) | |||
|---|---|---|---|
| msg82447 - (view) | Author: Antoine Pitrou (pitrou) *  |
Date: 2009-02-19 01:39 | |
When run with "make -jN", the Python compilation process is able to parallelize across N concurrent processes for the interpreter core, but extension modules are still compiled sequentially. |
|||
| msg116603 - (view) | Author: Éric Araujo (eric.araujo) * |
Date: 2010-09-16 20:24 | |
Do you want to work on a patch? |
|||
| msg178993 - (view) | Author: Antoine Pitrou (pitrou) * |
Date: 2013-01-03 22:27 | |
The original request is really about setup.py, not packaging. I don't care about packaging, and it's not in the stdlib. |
|||
| msg179010 - (view) | Author: Christian Heimes (christian.heimes) * |
Date: 2013-01-04 10:01 | |
+1 I think it's sufficient to parallelize the compilation step (.c -> .o) and ignore the linker step. Linking is usually so fast that it doesn't matter. Idea: * separate compile step from link step * run all compile calls for all extensions in parallel until all objects of all extensions are generated * do linking and error reporting in serial mode |
|||
| History | |||
|---|---|---|---|
| Date | User | Action | Args |
| 2013-01-04 10:01:17 | christian.heimes | set | nosy:
+ christian.heimes messages: + msg179010 |
| 2013-01-03 22:27:08 | pitrou | set | versions:
+ Python 3.4, - 3rd party title: packaging doesn't parallelize extension module compilation -> setup.py doesn't parallelize extension module compilation messages: + msg178993 assignee: tarek -> components: + Build, - Distutils2 |
| 2013-01-03 21:24:53 | bfroehle | set | nosy:
+ bfroehle |
| 2011-04-08 15:11:56 | eric.araujo | set | title: setup.py doesn't parallelize extension module compilation -> packaging doesn't parallelize extension module compilation |
| 2011-03-21 22:26:30 | eric.araujo | set | keywords:
+ gsoc nosy: pitrou, tarek, eric.araujo |
| 2010-09-29 23:51:32 | eric.araujo | set | versions: + 3rd party, - Python 2.6, Python 2.5, Python 3.1, Python 2.7, Python 3.2 |
| 2010-09-16 20:24:33 | eric.araujo | set | stage: needs patch messages: + msg116603 versions: + Python 2.6, Python 2.5, Python 3.1, Python 2.7 |
| 2010-09-16 16:18:40 | BreamoreBoy | set | nosy:
+ eric.araujo components: + Distutils2, - Distutils versions: + Python 3.2, - Python 3.1, Python 2.7 |
| 2009-02-19 01:39:51 | pitrou | create | |