This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author kieleth
Recipients davin, josh.r, kieleth
Date 2015-04-21.23:54:40
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1429660480.75.0.699987976243.issue23979@psf.upfronthosting.co.za>
In-reply-to
Content
Thanks for information and explanations.

The option of writing a tweaked serialization mechanism in Queue for Pool and implement a sharedmem sounds like fun, not sure if the pure-copy-on-write of forking can be achieved tho, it would be nice to know if it is actually possible (the project mentioned in issue17560 still needs to "dump" the arrays in the filesystem)

As quick fix for us, I've created a simple wrapper around Pool and its map, it creates a Queue for the results and uses Process to start the workers, this works just fine.

Simplicity and consistency are great, but I still believe that Pool, in LINUX-based systems, by serializing arguments, creates duplication and works inefficiently, and this could be avoided.

Obviously it's not me who takes the decisions and I don't have the time to investigate it further, so, after this petty rant, should we close this bug? :>
History
Date User Action Args
2015-04-21 23:54:40kielethsetrecipients: + kieleth, josh.r, davin
2015-04-21 23:54:40kielethsetmessageid: <1429660480.75.0.699987976243.issue23979@psf.upfronthosting.co.za>
2015-04-21 23:54:40kielethlinkissue23979 messages
2015-04-21 23:54:40kielethcreate