This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author pablogsal
Recipients Aaron Hall, anthony shaw, methane, ncoghlan, pablogsal, ronaldoussoren, serhiy.storchaka
Date 2019-04-08.23:31:24
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1554766285.19.0.355109960658.issue36551@roundup.psfhosted.org>
In-reply-to
Content
Here are the updated results for the benchmark suite. The previous results (unlinked from the issue to reduce noise)
were against an old version of the master branch.

2019-04-08_13-08-master-58721a903074.json.gz
============================================

Performance version: 0.7.0
Report on Linux-5.0.5-1-ARCH-x86_64-with-glibc2.28
Number of logical CPUs: 12
Start date: 2019-04-09 00:32:40.656576
End date: 2019-04-09 00:54:03.721798

12718-5f06333a4e49.json.gz
==========================

Performance version: 0.7.0
Report on Linux-5.0.5-1-ARCH-x86_64-with-glibc2.28
Number of logical CPUs: 12
Start date: 2019-04-09 00:07:53.433511
End date: 2019-04-09 00:29:32.603022

                                      
                                        -- CURRENT MASTER --                    -- PR12718 --
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| Benchmark               | 2019-04-08_13-08-master-58721a903074.json.gz | 12718-5f06333a4e49.json.gz | Change       | Significance           |
+=========================+==============================================+============================+==============+========================+
| 2to3                    | 455 ms                                       | 465 ms                     | 1.02x slower | Significant (t=-2.27)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| chaos                   | 171 ms                                       | 180 ms                     | 1.05x slower | Significant (t=-5.92)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| crypto_pyaes            | 169 ms                                       | 177 ms                     | 1.05x slower | Significant (t=-6.06)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| deltablue               | 11.5 ms                                      | 11.9 ms                    | 1.03x slower | Significant (t=-3.28)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| django_template         | 175 ms                                       | 191 ms                     | 1.09x slower | Significant (t=-13.00) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| dulwich_log             | 127 ms                                       | 131 ms                     | 1.03x slower | Significant (t=-8.97)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| fannkuch                | 646 ms                                       | 665 ms                     | 1.03x slower | Significant (t=-12.37) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| float                   | 165 ms                                       | 165 ms                     | 1.00x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| go                      | 386 ms                                       | 381 ms                     | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| hexiom                  | 15.4 ms                                      | 15.5 ms                    | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| html5lib                | 130 ms                                       | 132 ms                     | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| json_dumps              | 18.4 ms                                      | 18.3 ms                    | 1.00x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| json_loads              | 38.6 us                                      | 38.6 us                    | 1.00x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| logging_format          | 15.0 us                                      | 15.6 us                    | 1.04x slower | Significant (t=-10.98) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| logging_silent          | 284 ns                                       | 287 ns                     | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| logging_simple          | 13.5 us                                      | 13.9 us                    | 1.03x slower | Significant (t=-8.03)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| mako                    | 24.6 ms                                      | 24.5 ms                    | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| meteor_contest          | 157 ms                                       | 155 ms                     | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| nbody                   | 196 ms                                       | 198 ms                     | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| nqueens                 | 144 ms                                       | 147 ms                     | 1.02x slower | Significant (t=-9.68)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pathlib                 | 27.6 ms                                      | 28.4 ms                    | 1.03x slower | Significant (t=-5.24)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle                  | 14.1 us                                      | 14.2 us                    | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle_dict             | 33.7 us                                      | 35.2 us                    | 1.04x slower | Significant (t=-13.28) |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle_list             | 5.22 us                                      | 5.38 us                    | 1.03x slower | Significant (t=-6.65)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pickle_pure_python      | 681 us                                       | 719 us                     | 1.05x slower | Significant (t=-5.64)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| pidigits                | 217 ms                                       | 219 ms                     | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| python_startup          | 12.2 ms                                      | 12.5 ms                    | 1.02x slower | Significant (t=-9.34)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| python_startup_no_site  | 8.90 ms                                      | 8.92 ms                    | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| raytrace                | 789 ms                                       | 793 ms                     | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_compile           | 267 ms                                       | 270 ms                     | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_dna               | 221 ms                                       | 221 ms                     | 1.00x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_effbot            | 3.94 ms                                      | 3.98 ms                    | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| regex_v8                | 30.4 ms                                      | 30.4 ms                    | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| richards                | 108 ms                                       | 108 ms                     | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_fft             | 525 ms                                       | 525 ms                     | 1.00x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_lu              | 270 ms                                       | 271 ms                     | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_monte_carlo     | 160 ms                                       | 160 ms                     | 1.00x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_sor             | 295 ms                                       | 305 ms                     | 1.03x slower | Significant (t=-9.82)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| scimark_sparse_mat_mult | 6.63 ms                                      | 6.57 ms                    | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| spectral_norm           | 217 ms                                       | 219 ms                     | 1.01x slower | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sqlalchemy_declarative  | 239 ms                                       | 244 ms                     | 1.02x slower | Significant (t=-4.34)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sqlalchemy_imperative   | 50.7 ms                                      | 52.0 ms                    | 1.03x slower | Significant (t=-3.84)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sqlite_synth            | 4.20 us                                      | 4.14 us                    | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_expand            | 612 ms                                       | 637 ms                     | 1.04x slower | Significant (t=-8.36)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_integrate         | 27.5 ms                                      | 28.9 ms                    | 1.05x slower | Significant (t=-4.16)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_str               | 284 ms                                       | 299 ms                     | 1.05x slower | Significant (t=-6.97)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| sympy_sum               | 151 ms                                       | 156 ms                     | 1.03x slower | Significant (t=-4.37)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| telco                   | 9.70 ms                                      | 9.64 ms                    | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| tornado_http            | 276 ms                                       | 287 ms                     | 1.04x slower | Significant (t=-5.75)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpack_sequence         | 64.4 ns                                      | 67.3 ns                    | 1.05x slower | Significant (t=-6.16)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpickle                | 22.8 us                                      | 22.7 us                    | 1.01x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpickle_list           | 5.72 us                                      | 5.97 us                    | 1.04x slower | Significant (t=-6.05)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| unpickle_pure_python    | 510 us                                       | 527 us                     | 1.03x slower | Significant (t=-3.89)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_generate      | 150 ms                                       | 154 ms                     | 1.02x slower | Significant (t=-3.72)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_iterparse     | 145 ms                                       | 148 ms                     | 1.02x slower | Significant (t=-3.60)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_parse         | 208 ms                                       | 207 ms                     | 1.00x faster | Not significant        |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
| xml_etree_process       | 121 ms                                       | 125 ms                     | 1.04x slower | Significant (t=-5.43)  |
+-------------------------+----------------------------------------------+----------------------------+--------------+------------------------+
History
Date User Action Args
2019-04-08 23:31:25pablogsalsetrecipients: + pablogsal, ronaldoussoren, ncoghlan, methane, serhiy.storchaka, Aaron Hall, anthony shaw
2019-04-08 23:31:25pablogsalsetmessageid: <1554766285.19.0.355109960658.issue36551@roundup.psfhosted.org>
2019-04-08 23:31:25pablogsallinkissue36551 messages
2019-04-08 23:31:24pablogsalcreate