This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author fried
Recipients asvetlov, fried, lukasz.langa
Date 2016-06-03.18:55:37
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1464980137.78.0.803567676795.issue27199@psf.upfronthosting.co.za>
In-reply-to
Content
The default of 16k while good for memory usage it is not well suited for all cases. if we increased this to 4MB we saw a pretty large improvement to tar file creation and extraction on linux servers.

For a 1gb tar file containing 1024 random files each of 10MB in size.
Time Delta for TarFile: 146.3240258693695
Time Delta for FastTarFile 4MB copybufsize: 102.76440262794495
Time Diff: 43.55962324142456 0.2976928975444698
History
Date User Action Args
2016-06-03 18:55:37friedsetrecipients: + fried, asvetlov, lukasz.langa
2016-06-03 18:55:37friedsetmessageid: <1464980137.78.0.803567676795.issue27199@psf.upfronthosting.co.za>
2016-06-03 18:55:37friedlinkissue27199 messages
2016-06-03 18:55:37friedcreate