Author John Jones
Recipients John Jones, alex, benjamin.peterson, dhduvall, gennad, gregory.p.smith, neologix
Date 2017-03-17.12:08:14
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1489752494.41.0.227548700007.issue20104@psf.upfronthosting.co.za>
In-reply-to
Content
To prevent subprocess/os.fork() doubling my memory after loading a large numpy array into memory, I now have to start my script with 650 calls to subprocess.Popen(), which just sit their waiting for some stdin to start doing something. This doesn't happen until after the numpy array is loaded, else I quickly run out of memory.

I think this sort of situation results in more unnecessary complexity compared to using posix_spawn, in spite of the concerns about using posix_spawn. Perhaps subprocess.Popen just needs a "posix_spawn=True" parameter?
History
Date User Action Args
2017-03-17 12:08:14John Jonessetrecipients: + John Jones, gregory.p.smith, benjamin.peterson, alex, dhduvall, neologix, gennad
2017-03-17 12:08:14John Jonessetmessageid: <1489752494.41.0.227548700007.issue20104@psf.upfronthosting.co.za>
2017-03-17 12:08:14John Joneslinkissue20104 messages
2017-03-17 12:08:14John Jonescreate