> pyperf compare_to 310rc2.json 310rc2patched.json -G --min-speed=2 Slower (4): - python_startup_no_site: 35.5 ms +- 2.1 ms -> 51.5 ms +- 3.2 ms: 1.45x slower - python_startup: 49.2 ms +- 1.9 ms -> 63.3 ms +- 2.8 ms: 1.29x slower - pathlib: 263 ms +- 2 ms -> 271 ms +- 3 ms: 1.03x slower - sqlalchemy_imperative: 36.3 ms +- 1.1 ms -> 37.1 ms +- 1.1 ms: 1.02x slower Faster (34): - spectral_norm: 259 ms +- 4 ms -> 218 ms +- 9 ms: 1.19x faster - richards: 132 ms +- 6 ms -> 112 ms +- 3 ms: 1.18x faster - raytrace: 848 ms +- 45 ms -> 723 ms +- 11 ms: 1.17x faster - chaos: 187 ms +- 4 ms -> 161 ms +- 3 ms: 1.16x faster - deltablue: 12.6 ms +- 0.5 ms -> 10.9 ms +- 0.2 ms: 1.15x faster - pickle_pure_python: 777 us +- 25 us -> 673 us +- 17 us: 1.15x faster - scimark_monte_carlo: 181 ms +- 5 ms -> 158 ms +- 7 ms: 1.15x faster - unpickle_pure_python: 533 us +- 23 us -> 471 us +- 9 us: 1.13x faster - nbody: 265 ms +- 5 ms -> 235 ms +- 4 ms: 1.13x faster - go: 392 ms +- 5 ms -> 349 ms +- 3 ms: 1.12x faster - telco: 10.9 ms +- 0.4 ms -> 9.71 ms +- 0.15 ms: 1.12x faster - scimark_fft: 693 ms +- 12 ms -> 621 ms +- 60 ms: 1.12x faster - chameleon: 16.4 ms +- 0.3 ms -> 14.8 ms +- 0.3 ms: 1.11x faster - scimark_sor: 339 ms +- 5 ms -> 305 ms +- 5 ms: 1.11x faster - crypto_pyaes: 186 ms +- 1 ms -> 169 ms +- 1 ms: 1.10x faster - mako: 26.0 ms +- 0.2 ms -> 23.6 ms +- 0.3 ms: 1.10x faster - django_template: 81.0 ms +- 1.4 ms -> 73.5 ms +- 1.0 ms: 1.10x faster - pyflate: 1.11 sec +- 0.02 sec -> 1.02 sec +- 0.02 sec: 1.09x faster - fannkuch: 804 ms +- 29 ms -> 739 ms +- 10 ms: 1.09x faster - unpack_sequence: 112 ns +- 8 ns -> 104 ns +- 9 ns: 1.08x faster - float: 193 ms +- 1 ms -> 180 ms +- 3 ms: 1.07x faster - xml_etree_process: 124 ms +- 1 ms -> 117 ms +- 2 ms: 1.07x faster - xml_etree_generate: 159 ms +- 4 ms -> 149 ms +- 3 ms: 1.07x faster - nqueens: 172 ms +- 3 ms -> 162 ms +- 3 ms: 1.06x faster - scimark_lu: 273 ms +- 14 ms -> 258 ms +- 15 ms: 1.06x faster - logging_simple: 19.0 us +- 0.3 us -> 18.0 us +- 0.5 us: 1.06x faster - logging_format: 20.3 us +- 0.3 us -> 19.4 us +- 0.5 us: 1.05x faster - regex_compile: 278 ms +- 3 ms -> 266 ms +- 2 ms: 1.04x faster - scimark_sparse_mat_mult: 8.10 ms +- 0.26 ms -> 7.77 ms +- 0.21 ms: 1.04x faster - unpickle: 22.4 us +- 1.3 us -> 21.6 us +- 1.4 us: 1.04x faster - meteor_contest: 173 ms +- 3 ms -> 167 ms +- 2 ms: 1.04x faster - sympy_expand: 845 ms +- 5 ms -> 819 ms +- 5 ms: 1.03x faster - json_dumps: 20.1 ms +- 0.3 ms -> 19.7 ms +- 0.3 ms: 1.02x faster - sympy_integrate: 37.2 ms +- 0.2 ms -> 36.5 ms +- 0.3 ms: 1.02x faster Benchmark hidden because not significant (20): 2to3, dulwich_log, hexiom, json_loads, logging_silent, pickle, pickle_dict, pickle_list, pidigits, regex_dna, regex_effbot, regex_v8, sqlalchemy_declarative, sqlite_synth, sympy_sum, sympy_str, tornado_http, unpickle_list, xml_etree_parse, xml_etree_iterparse Geometric mean: 1.04x faster > pyperf compare_to 310a7.json 310rc2patched.json -G --min-speed=2 Slower (37): - python_startup_no_site: 34.9 ms +- 2.3 ms -> 51.5 ms +- 3.2 ms: 1.48x slower - python_startup: 48.6 ms +- 3.1 ms -> 63.3 ms +- 2.8 ms: 1.30x slower - unpack_sequence: 87.5 ns +- 3.8 ns -> 104 ns +- 9 ns: 1.19x slower - logging_silent: 250 ns +- 7 ns -> 291 ns +- 10 ns: 1.16x slower - hexiom: 14.0 ms +- 0.3 ms -> 15.7 ms +- 3.0 ms: 1.12x slower - logging_simple: 16.1 us +- 0.2 us -> 18.0 us +- 0.5 us: 1.12x slower - nbody: 215 ms +- 7 ms -> 235 ms +- 4 ms: 1.09x slower - logging_format: 17.8 us +- 0.3 us -> 19.4 us +- 0.5 us: 1.09x slower - richards: 104 ms +- 6 ms -> 112 ms +- 3 ms: 1.08x slower - xml_etree_parse: 218 ms +- 3 ms -> 235 ms +- 3 ms: 1.08x slower - sqlalchemy_imperative: 34.5 ms +- 0.9 ms -> 37.1 ms +- 1.1 ms: 1.08x slower - xml_etree_iterparse: 158 ms +- 2 ms -> 168 ms +- 2 ms: 1.06x slower - pathlib: 255 ms +- 6 ms -> 271 ms +- 3 ms: 1.06x slower - pyflate: 963 ms +- 10 ms -> 1.02 sec +- 0.02 sec: 1.06x slower - unpickle_pure_python: 446 us +- 11 us -> 471 us +- 9 us: 1.06x slower - go: 332 ms +- 6 ms -> 349 ms +- 3 ms: 1.05x slower - 2to3: 622 ms +- 5 ms -> 655 ms +- 3 ms: 1.05x slower - chameleon: 14.2 ms +- 0.3 ms -> 14.8 ms +- 0.3 ms: 1.05x slower - pickle_pure_python: 643 us +- 20 us -> 673 us +- 17 us: 1.05x slower - nqueens: 155 ms +- 3 ms -> 162 ms +- 3 ms: 1.04x slower - xml_etree_process: 112 ms +- 1 ms -> 117 ms +- 2 ms: 1.04x slower - pickle_list: 7.11 us +- 0.20 us -> 7.35 us +- 0.24 us: 1.03x slower - crypto_pyaes: 163 ms +- 1 ms -> 169 ms +- 1 ms: 1.03x slower - deltablue: 10.6 ms +- 0.5 ms -> 10.9 ms +- 0.2 ms: 1.03x slower - regex_compile: 257 ms +- 16 ms -> 266 ms +- 2 ms: 1.03x slower - django_template: 71.3 ms +- 1.1 ms -> 73.5 ms +- 1.0 ms: 1.03x slower - scimark_fft: 602 ms +- 13 ms -> 621 ms +- 60 ms: 1.03x slower - sqlalchemy_declarative: 253 ms +- 4 ms -> 260 ms +- 4 ms: 1.03x slower - scimark_lu: 251 ms +- 15 ms -> 258 ms +- 15 ms: 1.03x slower - xml_etree_generate: 145 ms +- 3 ms -> 149 ms +- 3 ms: 1.03x slower - scimark_sor: 297 ms +- 27 ms -> 305 ms +- 5 ms: 1.03x slower - json_dumps: 19.2 ms +- 0.2 ms -> 19.7 ms +- 0.3 ms: 1.03x slower - tornado_http: 261 ms +- 3 ms -> 268 ms +- 4 ms: 1.03x slower - sympy_str: 493 ms +- 10 ms -> 506 ms +- 4 ms: 1.03x slower - meteor_contest: 164 ms +- 2 ms -> 167 ms +- 2 ms: 1.02x slower - float: 176 ms +- 3 ms -> 180 ms +- 3 ms: 1.02x slower - sympy_expand: 802 ms +- 16 ms -> 819 ms +- 5 ms: 1.02x slower Faster (2): - telco: 10.3 ms +- 0.2 ms -> 9.71 ms +- 0.15 ms: 1.06x faster - sympy_integrate: 37.9 ms +- 5.0 ms -> 36.5 ms +- 0.3 ms: 1.04x faster Benchmark hidden because not significant (19): chaos, dulwich_log, fannkuch, json_loads, mako, pickle, pickle_dict, pidigits, raytrace, regex_dna, regex_effbot, regex_v8, scimark_monte_carlo, scimark_sparse_mat_mult, spectral_norm, sqlite_synth, sympy_sum, unpickle, unpickle_list Geometric mean: 1.04x slower > pyperf check 310rc2patched.json hexiom ------ WARNING: the benchmark result may be unstable * the standard deviation (2.98 ms) is 19% of the mean (15.7 ms) * the maximum (32.2 ms) is 105% greater than the mean (15.7 ms) Try to rerun the benchmark with more runs, values and/or loops. Run 'python.exe -m pyperf system tune' command to reduce the system jitter. Use pyperf stats, pyperf dump and pyperf hist to analyze results. Use --quiet option to hide these warnings. python_startup -------------- WARNING: the benchmark result may be unstable * the maximum (102 ms) is 61% greater than the mean (63.3 ms) Try to rerun the benchmark with more runs, values and/or loops. Run 'python.exe -m pyperf system tune' command to reduce the system jitter. Use pyperf stats, pyperf dump and pyperf hist to analyze results. Use --quiet option to hide these warnings. python_startup_no_site ---------------------- WARNING: the benchmark result may be unstable * the maximum (95.3 ms) is 85% greater than the mean (51.5 ms) Try to rerun the benchmark with more runs, values and/or loops. Run 'python.exe -m pyperf system tune' command to reduce the system jitter. Use pyperf stats, pyperf dump and pyperf hist to analyze results. Use --quiet option to hide these warnings.