Message 289758 - Python tracker

➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author	John Jones
Recipients	John Jones, alex, benjamin.peterson, dhduvall, gennad, gregory.p.smith, neologix
Date	2017-03-17.12:08:14
SpamBayes Score	-1.0
Marked as misclassified	Yes
Message-id	<1489752494.41.0.227548700007.issue20104@psf.upfronthosting.co.za>
In-reply-to

Content
To prevent subprocess/os.fork() doubling my memory after loading a large numpy array into memory, I now have to start my script with 650 calls to subprocess.Popen(), which just sit their waiting for some stdin to start doing something. This doesn't happen until after the numpy array is loaded, else I quickly run out of memory. I think this sort of situation results in more unnecessary complexity compared to using posix_spawn, in spite of the concerns about using posix_spawn. Perhaps subprocess.Popen just needs a "posix_spawn=True" parameter?

To prevent subprocess/os.fork() doubling my memory after loading a large numpy array into memory, I now have to start my script with 650 calls to subprocess.Popen(), which just sit their waiting for some stdin to start doing something. This doesn't happen until after the numpy array is loaded, else I quickly run out of memory.

I think this sort of situation results in more unnecessary complexity compared to using posix_spawn, in spite of the concerns about using posix_spawn. Perhaps subprocess.Popen just needs a "posix_spawn=True" parameter?

History
Date	User	Action	Args
2017-03-17 12:08:14	John Jones	set	recipients: + John Jones, gregory.p.smith, benjamin.peterson, alex, dhduvall, neologix, gennad
2017-03-17 12:08:14	John Jones	set	messageid: <1489752494.41.0.227548700007.issue20104@psf.upfronthosting.co.za>
2017-03-17 12:08:14	John Jones	link	issue20104 messages
2017-03-17 12:08:14	John Jones	create