Author eric.snow
Recipients Johan Dahlin, emilyemorehouse, eric.snow, nascheme, ncoghlan, pmpp, serhiy.storchaka, vstinner, yselivanov
Date 2019-02-26.04:10:24
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1551154224.46.0.696199819315.issue33608@roundup.psfhosted.org>
In-reply-to
Content
Here's what I did (more or less):

$ python3 -m pip install --user perf
$ python3 -m perf system tune
$ git clone git@github.com:python/performance.git
$ git clone git@github.com:python/cpython.git
$ cd cpython
$ git checkout ef4ac967e2f3a9a18330cc6abe14adb4bc3d0465
$ ./configure
$ make -j8
$ ./python ../performance/pyperformance run --fast --output speed.after
$ git checkout HEAD^
$ make -j8
$ ./python ../performance/pyperformance run --fast --output speed.before
$ ./python ../performance/pyperformance compare speed.before speed.after -O table

Here are my results:

speed.before
============

Performance version: 0.7.0
Report on Linux-4.15.0-45-generic-x86_64-with-glibc2.26
Number of logical CPUs: 4
Start date: 2019-02-25 20:39:44.151699
End date: 2019-02-25 20:48:04.817516

speed.after
===========

Performance version: 0.7.0
Report on Linux-4.15.0-45-generic-x86_64-with-glibc2.26
Number of logical CPUs: 4
Start date: 2019-02-25 20:29:56.610702
End date: 2019-02-25 20:38:11.667461

+-------------------------+--------------+-------------+--------------+-----------------------+
| Benchmark               | speed.before | speed.after | Change       | Significance          |
+=========================+==============+=============+==============+=======================+
| 2to3                    | 447 ms       | 440 ms      | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| chaos                   | 155 ms       | 156 ms      | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| crypto_pyaes            | 154 ms       | 152 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| deltablue               | 10.7 ms      | 10.5 ms     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| django_template         | 177 ms       | 172 ms      | 1.03x faster | Significant (t=3.66)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| dulwich_log             | 105 ms       | 106 ms      | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| fannkuch                | 572 ms       | 573 ms      | 1.00x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| float                   | 149 ms       | 146 ms      | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| go                      | 351 ms       | 349 ms      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| hexiom                  | 14.6 ms      | 14.4 ms     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| html5lib                | 126 ms       | 122 ms      | 1.03x faster | Significant (t=3.46)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| json_dumps              | 17.6 ms      | 17.2 ms     | 1.02x faster | Significant (t=2.65)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| json_loads              | 36.4 us      | 36.1 us     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| logging_format          | 15.2 us      | 14.9 us     | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| logging_silent          | 292 ns       | 296 ns      | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| logging_simple          | 13.7 us      | 13.4 us     | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| mako                    | 22.9 ms      | 22.5 ms     | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| meteor_contest          | 134 ms       | 134 ms      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| nbody                   | 157 ms       | 161 ms      | 1.03x slower | Significant (t=-3.85) |
+-------------------------+--------------+-------------+--------------+-----------------------+
| nqueens                 | 134 ms       | 132 ms      | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| pathlib                 | 30.1 ms      | 31.0 ms     | 1.03x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| pickle                  | 11.5 us      | 11.6 us     | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| pickle_dict             | 29.5 us      | 30.5 us     | 1.03x slower | Significant (t=-6.37) |
+-------------------------+--------------+-------------+--------------+-----------------------+
| pickle_list             | 4.54 us      | 4.58 us     | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| pickle_pure_python      | 652 us       | 651 us      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| pidigits                | 212 ms       | 215 ms      | 1.02x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| python_startup          | 11.6 ms      | 11.5 ms     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| python_startup_no_site  | 8.07 ms      | 7.95 ms     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| raytrace                | 729 ms       | 722 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| regex_compile           | 249 ms       | 247 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| regex_dna               | 203 ms       | 204 ms      | 1.00x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| regex_effbot            | 3.55 ms      | 3.55 ms     | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| regex_v8                | 28.3 ms      | 28.3 ms     | 1.00x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| richards                | 105 ms       | 105 ms      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| scimark_fft             | 429 ms       | 436 ms      | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| scimark_lu              | 238 ms       | 237 ms      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| scimark_monte_carlo     | 144 ms       | 139 ms      | 1.04x faster | Significant (t=3.61)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| scimark_sor             | 265 ms       | 260 ms      | 1.02x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| scimark_sparse_mat_mult | 5.41 ms      | 5.25 ms     | 1.03x faster | Significant (t=4.26)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| spectral_norm           | 174 ms       | 173 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sqlalchemy_declarative  | 216 ms       | 214 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sqlalchemy_imperative   | 41.6 ms      | 41.2 ms     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sqlite_synth            | 3.99 us      | 3.91 us     | 1.02x faster | Significant (t=2.49)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sympy_expand            | 559 ms       | 559 ms      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sympy_integrate         | 25.2 ms      | 25.3 ms     | 1.00x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sympy_str               | 261 ms       | 260 ms      | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| sympy_sum               | 136 ms       | 138 ms      | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| telco                   | 8.36 ms      | 8.32 ms     | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| tornado_http            | 273 ms       | 271 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| unpack_sequence         | 58.8 ns      | 60.0 ns     | 1.02x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| unpickle                | 21.5 us      | 21.5 us     | 1.00x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| unpickle_list           | 5.60 us      | 5.55 us     | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| unpickle_pure_python    | 497 us       | 481 us      | 1.03x faster | Significant (t=5.04)  |
+-------------------------+--------------+-------------+--------------+-----------------------+
| xml_etree_generate      | 141 ms       | 140 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| xml_etree_iterparse     | 131 ms       | 133 ms      | 1.01x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| xml_etree_parse         | 186 ms       | 187 ms      | 1.00x slower | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
| xml_etree_process       | 115 ms       | 113 ms      | 1.01x faster | Not significant       |
+-------------------------+--------------+-------------+--------------+-----------------------+
History
Date User Action Args
2019-02-26 04:10:24eric.snowsetrecipients: + eric.snow, nascheme, ncoghlan, vstinner, pmpp, serhiy.storchaka, yselivanov, emilyemorehouse, Johan Dahlin
2019-02-26 04:10:24eric.snowsetmessageid: <1551154224.46.0.696199819315.issue33608@roundup.psfhosted.org>
2019-02-26 04:10:24eric.snowlinkissue33608 messages
2019-02-26 04:10:24eric.snowcreate