$ hg id 17c9f1627baf+ tip $ ../benchmarks/perf.py -b 2n3 python_original python_setalloc Running call_method... INFO:root:Running python_setalloc ../benchmarks/performance/bm_call_method.py -n 150 INFO:root:Running python_original ../benchmarks/performance/bm_call_method.py -n 150 Running call_method_slots... INFO:root:Running python_setalloc ../benchmarks/performance/bm_call_method_slots.py -n 150 INFO:root:Running python_original ../benchmarks/performance/bm_call_method_slots.py -n 150 Running call_method_unknown... INFO:root:Running python_setalloc ../benchmarks/performance/bm_call_method_unknown.py -n 150 INFO:root:Running python_original ../benchmarks/performance/bm_call_method_unknown.py -n 150 Running call_simple... INFO:root:Running python_setalloc ../benchmarks/performance/bm_call_simple.py -n 150 INFO:root:Running python_original ../benchmarks/performance/bm_call_simple.py -n 150 Running chaos... INFO:root:Running python_setalloc ../benchmarks/performance/bm_chaos.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_chaos.py -n 50 Running django_v2... INFO:root:Running python_setalloc ../benchmarks/performance/bm_django_v2.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_django_v2.py -n 50 Running fannkuch... INFO:root:Running python_setalloc ../benchmarks/performance/bm_fannkuch.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_fannkuch.py -n 50 Running fastpickle... INFO:root:Running python_setalloc ../benchmarks/performance/bm_pickle.py -n 50 --use_cpickle pickle INFO:root:Running python_original ../benchmarks/performance/bm_pickle.py -n 50 --use_cpickle pickle Running fastunpickle... INFO:root:Running python_setalloc ../benchmarks/performance/bm_pickle.py -n 50 --use_cpickle unpickle INFO:root:Running python_original ../benchmarks/performance/bm_pickle.py -n 50 --use_cpickle unpickle Running float... INFO:root:Running python_setalloc ../benchmarks/performance/bm_float.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_float.py -n 50 Running formatted_logging... INFO:root:Running python_setalloc ../benchmarks/performance/bm_logging.py -n 50 formatted_output INFO:root:Running python_original ../benchmarks/performance/bm_logging.py -n 50 formatted_output Running go... INFO:root:Running python_setalloc ../benchmarks/performance/bm_go.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_go.py -n 50 Running hexiom2... INFO:root:Running python_setalloc ../benchmarks/performance/bm_hexiom2.py -n 2 INFO:root:Running python_original ../benchmarks/performance/bm_hexiom2.py -n 2 Running iterative_count... INFO:root:Running python_setalloc ../benchmarks/performance/bm_threading.py -n 50 iterative_count INFO:root:Running python_original ../benchmarks/performance/bm_threading.py -n 50 iterative_count Running json_dump_v2... INFO:root:Running python_setalloc ../benchmarks/performance/bm_json_v2.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_json_v2.py -n 50 Running json_load... INFO:root:Running python_setalloc ../benchmarks/performance/bm_json.py -n 50 json_load INFO:root:Running python_original ../benchmarks/performance/bm_json.py -n 50 json_load Running meteor_contest... INFO:root:Running python_setalloc ../benchmarks/performance/bm_meteor_contest.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_meteor_contest.py -n 50 Running nbody... INFO:root:Running python_setalloc ../benchmarks/performance/bm_nbody.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_nbody.py -n 50 Running normal_startup... INFO:root:Running `['python_setalloc', '-c', '']` 1000 times INFO:root:Running `['python_original', '-c', '']` 1000 times Running nqueens... INFO:root:Running python_setalloc ../benchmarks/performance/bm_nqueens.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_nqueens.py -n 50 Running pathlib... INFO:root:Running python_setalloc ../benchmarks/performance/bm_pathlib.py -n 500 INFO:root:Running python_original ../benchmarks/performance/bm_pathlib.py -n 500 Running pidigits... INFO:root:Running python_setalloc ../benchmarks/performance/bm_pidigits.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_pidigits.py -n 50 Running raytrace... INFO:root:Running python_setalloc ../benchmarks/performance/bm_raytrace.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_raytrace.py -n 50 Running regex_compile... INFO:root:Running python_setalloc ../benchmarks/performance/bm_regex_compile.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_regex_compile.py -n 50 Running regex_effbot... INFO:root:Running python_setalloc ../benchmarks/performance/bm_regex_effbot.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_regex_effbot.py -n 50 Running regex_v8... INFO:root:Running python_setalloc ../benchmarks/performance/bm_regex_v8.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_regex_v8.py -n 50 Running richards... INFO:root:Running python_setalloc ../benchmarks/performance/bm_richards.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_richards.py -n 50 Running silent_logging... INFO:root:Running python_setalloc ../benchmarks/performance/bm_logging.py -n 50 no_output INFO:root:Running python_original ../benchmarks/performance/bm_logging.py -n 50 no_output Running simple_logging... INFO:root:Running python_setalloc ../benchmarks/performance/bm_logging.py -n 50 simple_output INFO:root:Running python_original ../benchmarks/performance/bm_logging.py -n 50 simple_output Running spectral_norm... INFO:root:Running python_setalloc ../benchmarks/performance/bm_spectral_norm.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_spectral_norm.py -n 50 Running startup_nosite... INFO:root:Running `['python_setalloc', '-S', '-c', '']` 2000 times INFO:root:Running `['python_original', '-S', '-c', '']` 2000 times Running telco... INFO:root:Running python_setalloc ../benchmarks/performance/bm_telco.py -n 50 INFO:root:Running python_original ../benchmarks/performance/bm_telco.py -n 50 Running threaded_count... INFO:root:Running python_setalloc ../benchmarks/performance/bm_threading.py -n 50 threaded_count INFO:root:Running python_original ../benchmarks/performance/bm_threading.py -n 50 threaded_count Running unpack_sequence... INFO:root:Running python_setalloc ../benchmarks/performance/bm_unpack_sequence.py -n 50000 INFO:root:Running python_original ../benchmarks/performance/bm_unpack_sequence.py -n 50000 Report on Linux DSK000552 3.2.0-45-generic-pae #70-Ubuntu SMP Wed May 29 20:31:05 UTC 2013 i686 i686 Total CPU cores: 4 ### call_method_unknown ### Min: 0.325759 -> 0.314312: 1.04x faster Avg: 0.326603 -> 0.315165: 1.04x faster Significant (t=115.56) Stddev: 0.00101 -> 0.00067: 1.5152x smaller ### float ### Min: 0.298738 -> 0.294862: 1.01x faster Avg: 0.310603 -> 0.300048: 1.04x faster Significant (t=3.66) Stddev: 0.02013 -> 0.00336: 5.9841x smaller ### hexiom2 ### Min: 134.998561 -> 130.514728: 1.03x faster Avg: 135.024076 -> 130.518067: 1.03x faster Significant (t=175.10) Stddev: 0.03608 -> 0.00472: 7.6433x smaller ### iterative_count ### Min: 0.133259 -> 0.136194: 1.02x slower Avg: 0.133985 -> 0.140607: 1.05x slower Significant (t=-2.99) Stddev: 0.00104 -> 0.01564: 15.1080x larger ### json_load ### Min: 0.460105 -> 0.472533: 1.03x slower Avg: 0.461766 -> 0.474442: 1.03x slower Significant (t=-44.55) Stddev: 0.00102 -> 0.00173: 1.7002x larger ### meteor_contest ### Min: 0.196714 -> 0.201647: 1.03x slower Avg: 0.198286 -> 0.202996: 1.02x slower Significant (t=-22.40) Stddev: 0.00138 -> 0.00055: 2.5168x smaller ### pathlib ### Min: 0.117151 -> 0.114019: 1.03x faster Avg: 0.118084 -> 0.114757: 1.03x faster Significant (t=72.58) Stddev: 0.00053 -> 0.00050: 1.0658x smaller ### regex_compile ### Min: 0.410076 -> 0.395809: 1.04x faster Avg: 0.418842 -> 0.399673: 1.05x faster Significant (t=10.40) Stddev: 0.01058 -> 0.00760: 1.3924x smaller ### richards ### Min: 0.204947 -> 0.192873: 1.06x faster Avg: 0.208729 -> 0.195695: 1.07x faster Significant (t=19.06) Stddev: 0.00421 -> 0.00238: 1.7717x smaller ### silent_logging ### Min: 0.081866 -> 0.075911: 1.08x faster Avg: 0.085342 -> 0.077347: 1.10x faster Significant (t=12.09) Stddev: 0.00453 -> 0.00117: 3.8666x smaller ### spectral_norm ### Min: 0.332638 -> 0.323187: 1.03x faster Avg: 0.334681 -> 0.327450: 1.02x faster Significant (t=29.36) Stddev: 0.00105 -> 0.00139: 1.3312x larger ### startup_nosite ### Min: 0.401964 -> 0.419005: 1.04x slower Avg: 0.444805 -> 0.456754: 1.03x slower Significant (t=-5.28) Stddev: 0.01326 -> 0.01833: 1.3828x larger ### threaded_count ### Min: 0.297519 -> 0.308912: 1.04x slower Avg: 0.363765 -> 0.378004: 1.04x slower Significant (t=-2.33) Stddev: 0.02984 -> 0.03113: 1.0431x larger ### unpack_sequence ### Min: 0.000046 -> 0.000046: 1.01x slower Avg: 0.000047 -> 0.000050: 1.07x slower Significant (t=-191.08) Stddev: 0.00000 -> 0.00000: 1.1046x larger The following not significant results are hidden, use -v to show them: call_method, call_method_slots, call_simple, chaos, django_v2, fannkuch, fastpickle, fastunpickle, formatted_logging, go, json_dump_v2, nbody, normal_startup, nqueens, pidigits, raytrace, regex_effbot, regex_v8, simple_logging, telco.