➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author Ruslan Dautkhanov
Recipients Ruslan Dautkhanov
Date 2018-11-22.01:02:30
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1542848552.12.0.788709270274.issue35294@psf.upfronthosting.co.za>
In-reply-to
Content 
We had a long discussion in https://issues.apache.org/jira/browse/SPARK-26019
regarding a race condition that happens 
around https://github.com/apache/spark/blob/master/python/pyspark/accumulators.py#L289 

The fix I created here -
https://github.com/apache/spark/pull/23113/files
basically changes bind_and_activate to False 
in SocketServer.TCPServer.__init__'s call 
and manually doing 
            self.server_bind()
            self.server_activate()
            self.serve_forever()
in that thread instead of main thread. 

We have a fix, but we're not sure if this is a bug in Python with multithreading / handling SocketServer.TCPServer ?

Thank you.
History
Date User Action Args
2018-11-22 01:02:32Ruslan Dautkhanovsetrecipients: + Ruslan Dautkhanov
2018-11-22 01:02:32Ruslan Dautkhanovsetmessageid: <1542848552.12.0.788709270274.issue35294@psf.upfronthosting.co.za>
2018-11-22 01:02:31Ruslan Dautkhanovlinkissue35294 messages
2018-11-22 01:02:30Ruslan Dautkhanovcreate