Author jorgsk
Recipients alexandre.vassalotti, amaury.forgeotdarc, belopolsky, jorgsk, nyevik, pitrou, santoso.wijaya
Date 2011-07-28.07:47:20
SpamBayes Score 0.00139651
Marked as misclassified No
Message-id <1311839241.74.0.975749573056.issue11564@psf.upfronthosting.co.za>
In-reply-to
Content
I recently ran into this problem when I tried to multiprocess jobs with large objects (3-4 GB). I have plenty of memory for this, but multiprocessing hangs without error, presumably because pickle hangs without error when multiprocessing tries to pickle the object. I can't offer a solution, but I can verify that the limitation in pickle is affecting Python usage.
History
Date User Action Args
2011-07-28 07:47:22jorgsksetrecipients: + jorgsk, amaury.forgeotdarc, belopolsky, pitrou, alexandre.vassalotti, santoso.wijaya, nyevik
2011-07-28 07:47:21jorgsksetmessageid: <1311839241.74.0.975749573056.issue11564@psf.upfronthosting.co.za>
2011-07-28 07:47:21jorgsklinkissue11564 messages
2011-07-28 07:47:20jorgskcreate