Message313387
Hi,
No, using the affinity's not useful to us as, in the general case, the batch system (PBS Pro in our case) isn't using cgroups or cpusets (it does control ave cpu use by monitoring rusage of the process group).
Several other batch system I've worked with either set NCPUS directly or have a method for site-specific customisation of the job's environment.
That doesn't preclude using the affinity as an alternative to os.cpu_count()
As @pitrou correctly observes, probably better to have a simple, well-sign-posted way for the sysadmins to influence the pool default than try to overload multiprocessing with complex heuristics. |
|
Date |
User |
Action |
Args |
2018-03-07 12:38:23 | Matt Harvey | set | recipients:
+ Matt Harvey, pitrou, njs, davin, Matthew Rocklin, M J Harvey |
2018-03-07 12:38:23 | Matt Harvey | set | messageid: <1520426303.18.0.467229070634.issue32986@psf.upfronthosting.co.za> |
2018-03-07 12:38:23 | Matt Harvey | link | issue32986 messages |
2018-03-07 12:38:23 | Matt Harvey | create | |
|