classification
Title: Multiprocessing Send to Manager Fails for Large Payload
Type: enhancement Stage: needs patch
Components: Library (Lib) Versions: Python 3.7
process
Status: open Resolution:
Dependencies: Superseder:
Assigned To: Nosy List: davin, maxehr, pitrou
Priority: normal Keywords:

Created on 2017-06-16 16:12 by maxehr, last changed 2017-06-28 19:12 by pitrou.

Messages (2)
msg296210 - (view) Author: Max Ehrlich (maxehr) Date: 2017-06-16 16:12
On line 393 of multiprocessing/connection.py, the size of the payload to be sent is serialized as an integer. This fails for sending large payloads. It should probably be serialized as a long or better yet a long long.
msg297210 - (view) Author: Antoine Pitrou (pitrou) * (Python committer) Date: 2017-06-28 19:12
As the comment just above that line says, this is for wire compatibility with older Python versions.

But we could have an escape hatch: a special value of the length (which happens to be encoded as a signed integer), such as -64, which would signal a following 64-bit length field.  Would you like to submit a PR?
History
Date User Action Args
2017-06-28 19:12:58pitrousetversions: + Python 3.7, - Python 3.5
nosy: + pitrou, davin

messages: + msg297210

type: enhancement
stage: needs patch
2017-06-16 16:12:46maxehrcreate