This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author Matt Harvey
Recipients M J Harvey, Matt Harvey, Matthew Rocklin, davin, njs, pitrou
Date 2018-03-07.12:38:23
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1520426303.18.0.467229070634.issue32986@psf.upfronthosting.co.za>
In-reply-to
Content
Hi,

No, using the affinity's not useful to us as, in the general case, the batch system (PBS Pro in our case) isn't using cgroups or cpusets (it does control ave cpu use by monitoring rusage of the process group). 

Several other batch system I've worked with either set NCPUS directly or have a method for site-specific customisation of the job's environment.

That doesn't preclude using the affinity as an alternative to os.cpu_count()

As @pitrou correctly observes, probably better to have a simple, well-sign-posted way for the sysadmins to influence the pool default than try to overload multiprocessing with complex heuristics.
History
Date User Action Args
2018-03-07 12:38:23Matt Harveysetrecipients: + Matt Harvey, pitrou, njs, davin, Matthew Rocklin, M J Harvey
2018-03-07 12:38:23Matt Harveysetmessageid: <1520426303.18.0.467229070634.issue32986@psf.upfronthosting.co.za>
2018-03-07 12:38:23Matt Harveylinkissue32986 messages
2018-03-07 12:38:23Matt Harveycreate