Message374414
I have tried a different approach using https://gitlab.com/tenzing/shared-array and I got it to perform well on Linux.
Basically, the code above places all numpy arrays in /dev/shm which allows you to access and modify them from any number of processes without creating any copies; for deleting is equally simple - The code provides a SharedArray.list() to list all objects that itself placed in /dev/shm and so one can just iterate over the list and delete each element. (An easier approach is to use PathLib and just unlik all shared memory objects in /dev/shm)
I guess a solution based on Mat's code could be adapted to try and solve the shared-memory problems.
I look forward for further discussion on the subject.
Diogo |
|
Date |
User |
Action |
Args |
2020-07-27 18:47:16 | dxflores | set | recipients:
+ dxflores, pitrou, python-dev, davin, davidparks21, vinay0410, jfischer, fvdnabee, rauanargyn |
2020-07-27 18:47:15 | dxflores | set | messageid: <1595875636.0.0.013946945669.issue39959@roundup.psfhosted.org> |
2020-07-27 18:47:15 | dxflores | link | issue39959 messages |
2020-07-27 18:47:15 | dxflores | create | |
|