bench-base.json =============== Performance version: 1.0.2 Report on Linux-5.10.0-8-amd64-x86_64-with-glibc2.31 Number of logical CPUs: 8 Start date: 2021-08-15 13:06:10.774719 End date: 2021-08-15 13:24:22.256023 bench-trashcan.json =================== Performance version: 1.0.2 Report on Linux-5.10.0-8-amd64-x86_64-with-glibc2.31 Number of logical CPUs: 8 Start date: 2021-08-15 12:41:56.318241 End date: 2021-08-15 13:00:24.029167 +-------------------------+-----------------+---------------------+--------------+------------------------+ | Benchmark | bench-base.json | bench-trashcan.json | Change | Significance | +=========================+=================+=====================+==============+========================+ | 2to3 | 290 ms | 292 ms | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | chameleon | 8.22 ms | 8.22 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | chaos | 86.9 ms | 88.3 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | crypto_pyaes | 97.2 ms | 100 ms | 1.03x slower | Significant (t=-6.44) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | deltablue | 6.16 ms | 6.04 ms | 1.02x faster | Significant (t=3.39) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | django_template | 44.2 ms | 44.3 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | dulwich_log | 79.2 ms | 80.6 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | fannkuch | 443 ms | 458 ms | 1.03x slower | Significant (t=-7.13) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | float | 90.4 ms | 92.4 ms | 1.02x slower | Significant (t=-3.18) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | go | 182 ms | 182 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | hexiom | 8.39 ms | 8.49 ms | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | json_dumps | 12.5 ms | 12.6 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | json_loads | 25.3 us | 26.4 us | 1.04x slower | Significant (t=-4.14) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | logging_format | 7.79 us | 8.02 us | 1.03x slower | Significant (t=-7.90) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | logging_silent | 164 ns | 165 ns | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | logging_simple | 7.09 us | 7.17 us | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | mako | 14.8 ms | 14.3 ms | 1.04x faster | Significant (t=8.87) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | meteor_contest | 101 ms | 104 ms | 1.03x slower | Significant (t=-9.55) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | nbody | 126 ms | 128 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | nqueens | 90.4 ms | 90.5 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pathlib | 19.2 ms | 19.5 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pickle | 10.2 us | 10.8 us | 1.05x slower | Significant (t=-2.69) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pickle_dict | 26.6 us | 27.3 us | 1.02x slower | Significant (t=-8.06) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pickle_list | 4.08 us | 4.00 us | 1.02x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pickle_pure_python | 420 us | 423 us | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pidigits | 167 ms | 168 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | pyflate | 585 ms | 589 ms | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | python_startup | 8.53 ms | 8.53 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | python_startup_no_site | 5.77 ms | 5.76 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | raytrace | 407 ms | 409 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | regex_compile | 160 ms | 159 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | regex_dna | 189 ms | 191 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | regex_effbot | 2.95 ms | 3.03 ms | 1.03x slower | Significant (t=-18.16) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | regex_v8 | 21.9 ms | 22.0 ms | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | richards | 65.5 ms | 66.1 ms | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | scimark_fft | 371 ms | 371 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | scimark_lu | 148 ms | 158 ms | 1.07x slower | Significant (t=-11.28) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | scimark_monte_carlo | 81.5 ms | 83.1 ms | 1.02x slower | Significant (t=-10.24) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | scimark_sor | 177 ms | 180 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | scimark_sparse_mat_mult | 5.13 ms | 5.22 ms | 1.02x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | spectral_norm | 138 ms | 144 ms | 1.04x slower | Significant (t=-10.80) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sqlalchemy_declarative | 141 ms | 141 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sqlalchemy_imperative | 21.0 ms | 20.6 ms | 1.02x faster | Significant (t=2.52) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sqlite_synth | 2.54 us | 2.56 us | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sympy_expand | 535 ms | 531 ms | 1.01x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sympy_integrate | 22.5 ms | 22.4 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sympy_str | 319 ms | 320 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | sympy_sum | 179 ms | 177 ms | 1.01x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | telco | 6.29 ms | 6.36 ms | 1.01x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | tornado_http | 138 ms | 136 ms | 1.01x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | unpack_sequence | 51.2 ns | 52.9 ns | 1.03x slower | Significant (t=-4.86) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | unpickle | 14.0 us | 13.6 us | 1.03x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | unpickle_list | 4.66 us | 4.55 us | 1.03x faster | Significant (t=4.22) | +-------------------------+-----------------+---------------------+--------------+------------------------+ | unpickle_pure_python | 291 us | 290 us | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | xml_etree_generate | 87.9 ms | 87.5 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | xml_etree_iterparse | 103 ms | 102 ms | 1.00x faster | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | xml_etree_parse | 139 ms | 139 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+ | xml_etree_process | 66.6 ms | 66.8 ms | 1.00x slower | Not significant | +-------------------------+-----------------+---------------------+--------------+------------------------+