Author synapse
Recipients synapse
Date 2010-11-25.11:15:10
SpamBayes Score 2.47477e-07
Marked as misclassified No
Message-id <1290683713.67.0.950545103714.issue10527@psf.upfronthosting.co.za>
In-reply-to
Content
Hello,

I have a code that uses multiprocessing.Pipe to communicate with subprocesses. Spawning 500 subprocesses this way works like a charm, but when spawning about 600 of them the pipe ends raise the exception: "handle out of range in select()". I realized that this is because of the FD_SETSIZE limit. To address the situation I quickly hacked together a patch that uses poll() instead of select(), which solves the problem for me. I don't know the reason why select() was chosen for this task (maybe because of windows) but wouldn't it be better to use polling where possible?

I've attached the tester. Beware, running it may use up all memory in your system, so be careful!

Gergely Kalman
History
Date User Action Args
2010-11-25 11:15:13synapsesetrecipients: + synapse
2010-11-25 11:15:13synapsesetmessageid: <1290683713.67.0.950545103714.issue10527@psf.upfronthosting.co.za>
2010-11-25 11:15:11synapselinkissue10527 messages
2010-11-25 11:15:11synapsecreate