Message339684
Here are the updated results for the benchmark suite. The previous results (unlinked from the issue to reduce noise)
were against an old version of the master branch.
2019-04-08_13-08-master-58721a903074.json.gz
============================================
Performance version: 0.7.0
Report on Linux-5.0.5-1-ARCH-x86_64-with-glibc2.28
Number of logical CPUs: 12
Start date: 2019-04-09 00:32:40.656576
End date: 2019-04-09 00:54:03.721798
12718-5f06333a4e49.json.gz
==========================
Performance version: 0.7.0
Report on Linux-5.0.5-1-ARCH-x86_64-with-glibc2.28
Number of logical CPUs: 12
Start date: 2019-04-09 00:07:53.433511
End date: 2019-04-09 00:29:32.603022
-- CURRENT MASTER -- -- PR12718 --
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| Benchmark | 2019-04-08_13-08-master-58721a903074.json.gz | 12718-5f06333a4e49.json.gz | Change | Significance |
+=========================+==============================================+============================+==============+========================+
| 2to3 | 455 ms | 465 ms | 1.02x slower | Significant (t=-2.27) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| chaos | 171 ms | 180 ms | 1.05x slower | Significant (t=-5.92) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| crypto_pyaes | 169 ms | 177 ms | 1.05x slower | Significant (t=-6.06) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| deltablue | 11.5 ms | 11.9 ms | 1.03x slower | Significant (t=-3.28) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| django_template | 175 ms | 191 ms | 1.09x slower | Significant (t=-13.00) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| dulwich_log | 127 ms | 131 ms | 1.03x slower | Significant (t=-8.97) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| fannkuch | 646 ms | 665 ms | 1.03x slower | Significant (t=-12.37) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| float | 165 ms | 165 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| go | 386 ms | 381 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| hexiom | 15.4 ms | 15.5 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| html5lib | 130 ms | 132 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| json_dumps | 18.4 ms | 18.3 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| json_loads | 38.6 us | 38.6 us | 1.00x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| logging_format | 15.0 us | 15.6 us | 1.04x slower | Significant (t=-10.98) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| logging_silent | 284 ns | 287 ns | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| logging_simple | 13.5 us | 13.9 us | 1.03x slower | Significant (t=-8.03) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| mako | 24.6 ms | 24.5 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| meteor_contest | 157 ms | 155 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| nbody | 196 ms | 198 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| nqueens | 144 ms | 147 ms | 1.02x slower | Significant (t=-9.68) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pathlib | 27.6 ms | 28.4 ms | 1.03x slower | Significant (t=-5.24) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle | 14.1 us | 14.2 us | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle_dict | 33.7 us | 35.2 us | 1.04x slower | Significant (t=-13.28) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle_list | 5.22 us | 5.38 us | 1.03x slower | Significant (t=-6.65) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle_pure_python | 681 us | 719 us | 1.05x slower | Significant (t=-5.64) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pidigits | 217 ms | 219 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| python_startup | 12.2 ms | 12.5 ms | 1.02x slower | Significant (t=-9.34) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| python_startup_no_site | 8.90 ms | 8.92 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| raytrace | 789 ms | 793 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_compile | 267 ms | 270 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_dna | 221 ms | 221 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_effbot | 3.94 ms | 3.98 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_v8 | 30.4 ms | 30.4 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| richards | 108 ms | 108 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_fft | 525 ms | 525 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_lu | 270 ms | 271 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_monte_carlo | 160 ms | 160 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_sor | 295 ms | 305 ms | 1.03x slower | Significant (t=-9.82) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_sparse_mat_mult | 6.63 ms | 6.57 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| spectral_norm | 217 ms | 219 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sqlalchemy_declarative | 239 ms | 244 ms | 1.02x slower | Significant (t=-4.34) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sqlalchemy_imperative | 50.7 ms | 52.0 ms | 1.03x slower | Significant (t=-3.84) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sqlite_synth | 4.20 us | 4.14 us | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_expand | 612 ms | 637 ms | 1.04x slower | Significant (t=-8.36) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_integrate | 27.5 ms | 28.9 ms | 1.05x slower | Significant (t=-4.16) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_str | 284 ms | 299 ms | 1.05x slower | Significant (t=-6.97) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_sum | 151 ms | 156 ms | 1.03x slower | Significant (t=-4.37) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| telco | 9.70 ms | 9.64 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| tornado_http | 276 ms | 287 ms | 1.04x slower | Significant (t=-5.75) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpack_sequence | 64.4 ns | 67.3 ns | 1.05x slower | Significant (t=-6.16) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpickle | 22.8 us | 22.7 us | 1.01x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpickle_list | 5.72 us | 5.97 us | 1.04x slower | Significant (t=-6.05) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpickle_pure_python | 510 us | 527 us | 1.03x slower | Significant (t=-3.89) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_generate | 150 ms | 154 ms | 1.02x slower | Significant (t=-3.72) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_iterparse | 145 ms | 148 ms | 1.02x slower | Significant (t=-3.60) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_parse | 208 ms | 207 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_process | 121 ms | 125 ms | 1.04x slower | Significant (t=-5.43) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+ |
|
Date |
User |
Action |
Args |
2019-04-08 23:31:25 | pablogsal | set | recipients:
+ pablogsal, ronaldoussoren, ncoghlan, methane, serhiy.storchaka, Aaron Hall, anthony shaw |
2019-04-08 23:31:25 | pablogsal | set | messageid: <1554766285.19.0.355109960658.issue36551@roundup.psfhosted.org> |
2019-04-08 23:31:25 | pablogsal | link | issue36551 messages |
2019-04-08 23:31:24 | pablogsal | create | |
|