Author sbt
Recipients asksol, brandon-rhodes, catalin.iacob, christian.heimes, cool-RR, dholth, jnoller, mrmekon, ned.deily, neologix, numbernine, pitrou, rcoyner, sbt, vsekhar
Date 2012-11-20.16:11:21
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1353427882.04.0.771750643833.issue8713@psf.upfronthosting.co.za>
In-reply-to
Content
http://hg.python.org/sandbox/sbt#spawn now contains support for starting processes via a separate server process.  This depends on fd passing support.

This also solves the problem of mixing threads and processes, but is much faster than using fork+exec.  It seems to be just as fast as using plain fork.

I have tested it successfully on Linux and a MacOSX buildbot.  (OpenSolaris does not seem to support fd passing.)

At the begining of your program you write

    multiprocessing.set_start_method('forkserver')

to use the fork server.

Alternatively you can use

    multiprocessing.set_start_method('spawn')

to use _posixsubprocess.fork_exec() with closefds=True on Unix or 

    multiprocessing.set_start_method('fork')

to use the standard fork method.

This branch also stops child processes on Windows from automatically inheriting inheritable handles.

The test suite can be run with the different start methods by doing

    python -m test.test_multiprocessing_fork
    python -m test.test_multiprocessing_spawn
    python -m test.test_multiprocessing_forkserver
History
Date User Action Args
2012-11-20 16:11:22sbtsetrecipients: + sbt, pitrou, christian.heimes, ned.deily, jnoller, rcoyner, asksol, cool-RR, dholth, brandon-rhodes, neologix, catalin.iacob, numbernine, vsekhar, mrmekon
2012-11-20 16:11:22sbtsetmessageid: <1353427882.04.0.771750643833.issue8713@psf.upfronthosting.co.za>
2012-11-20 16:11:22sbtlinkissue8713 messages
2012-11-20 16:11:21sbtcreate