This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author rhettinger
Recipients alexandre.vassalotti, belopolsky, fdrake, mark.dickinson, pitrou, rhettinger
Date 2010-06-30.17:45:00
SpamBayes Score 0.05659385
Marked as misclassified No
Message-id <1277919902.77.0.0519030541831.issue9120@psf.upfronthosting.co.za>
In-reply-to
Content
>> People concerned about pickle size would be much better off investing >> time into a more generic solution (such as adding a code to
>> automatically run zip/gzip/bzip/xz etc).

> That's at the expense of (un)pickling speed, ...

Wanted to reply here so that the suggestion doesn't get lost.

When talking about pickle speed performance, we need to take into account that most use cases for pickle are i/o bound.  IOW, the time to pickle and unpickle is dominated by the time needed to read/write the pickle to/from disk or to send it across the wire.  In those common use cases, any time spent compressing/decompressing is more than made for by savings in transport/storage time.   This is a fairly common speed optimization and it would be nice if pickles supported it directly (i.e. the sender specifies a compression option and the receiver automatically detects the option from an opcode in the pickle.
History
Date User Action Args
2010-06-30 17:45:02rhettingersetrecipients: + rhettinger, fdrake, mark.dickinson, belopolsky, pitrou, alexandre.vassalotti
2010-06-30 17:45:02rhettingersetmessageid: <1277919902.77.0.0519030541831.issue9120@psf.upfronthosting.co.za>
2010-06-30 17:45:00rhettingerlinkissue9120 messages
2010-06-30 17:45:00rhettingercreate