Message314600
I'm using either multiprocessing package or concurrent.futures for some embarrassingly parallel application.
I performed a simple test: basically making n_jobs calls for a simple function - 'sum(list(range(n)))', with n large enough so that the operation is a few seconds long - where n_jobs > n_logical_cores.
Tried it on two platforms:
first platform:
server with X4 Intel Xeon E5-4620 (8 physical, 16 logical), running
a 64bit Windows Server 2012 R2 Standard.
***
second platform:
server with X2 Intel Xeon Gold 6138 (20 physical, 40 logical), running a 64bit Windows Server 2016 Standard.
***
first platform reaches 100% utilization.
second platform reaches 25% utilization. |
|
Date |
User |
Action |
Args |
2018-03-28 14:56:29 | yanirh | set | recipients:
+ yanirh, paul.moore, tim.golden, zach.ware, steve.dower |
2018-03-28 14:56:29 | yanirh | set | messageid: <1522248989.15.0.467229070634.issue33171@psf.upfronthosting.co.za> |
2018-03-28 14:56:29 | yanirh | link | issue33171 messages |
2018-03-28 14:56:29 | yanirh | create | |
|