+ '[' log '!=' log ']' + date jeu. mai 26 13:36:34 CEST 2016 + echo 'Original python: ../ref_default/python' Original python: ../ref_default/python + ../ref_default/python -c 'import sys; print(sys.version)' 3.6.0a1+ (default:90bb91be6f3b, May 26 2016, 13:06:36) [GCC 5.3.1 20160406 (Red Hat 5.3.1-6)] + echo + echo 'Patched python: ../fastcall2/python' Patched python: ../fastcall2/python + ../fastcall2/python -c 'import sys; print(sys.version)' 3.6.0a1+ (default:0ccd97332ff2, May 26 2016, 13:32:23) [GCC 5.3.1 20160406 (Red Hat 5.3.1-6)] + echo + date jeu. mai 26 13:36:34 CEST 2016 + echo + python3 -u perf.py --affinity=1 --rigorous ../ref_default/python ../fastcall2/python -b all,-hexiom2 INFO:root:Automatically selected timer: perf_counter Linux ASLR enabled? True (0) INFO:root:Skipping benchmark bzr_startup; not compatible with Python 3.6 INFO:root:Skipping benchmark slowspitfire; not compatible with Python 3.6 INFO:root:Skipping benchmark rietveld; not compatible with Python 3.6 INFO:root:Skipping benchmark spambayes; not compatible with Python 3.6 INFO:root:Skipping benchmark hg_startup; not compatible with Python 3.6 INFO:root:Skipping benchmark html5lib; not compatible with Python 3.6 INFO:root:Skipping benchmark pybench; not compatible with Python 3.6 INFO:root:Skipping benchmark slowunpickle; not compatible with Python 3.6 INFO:root:Skipping benchmark slowpickle; not compatible with Python 3.6 INFO:root:Skipping benchmark html5lib_warmup; not compatible with Python 3.6 [ 1/42] 2to3... INFO:root:Running `taskset --cpu-list 1 ../fastcall2/python lib3/2to3/2to3 -f all lib/2to3` 5 times INFO:root:Running `taskset --cpu-list 1 ../ref_default/python lib3/2to3/2to3 -f all lib/2to3` 5 times [ 2/42] call_method... run 50 process x 3 loops (total: 150) Total average: 260.0 ms +/- 1.2 ms (min: 258.4 ms, max: 264.8 ms) run 50 process x 3 loops (total: 150) Total average: 268.1 ms +/- 2.2 ms (min: 265.1 ms, max: 274.4 ms) [ 3/42] call_method_slots... run 50 process x 3 loops (total: 150) Total average: 260.5 ms +/- 0.9 ms (min: 259.2 ms, max: 263.1 ms) run 50 process x 3 loops (total: 150) Total average: 271.4 ms +/- 2.3 ms (min: 269.4 ms, max: 280.4 ms) [ 4/42] call_method_unknown... run 50 process x 3 loops (total: 150) Total average: 266.5 ms +/- 2.8 ms (min: 262.3 ms, max: 273.4 ms) run 50 process x 3 loops (total: 150) Total average: 273.6 ms +/- 2.1 ms (min: 269.5 ms, max: 279.5 ms) [ 5/42] call_simple... run 50 process x 1 loops (total: 50) Total average: 188.5 ms +/- 9.0 ms (min: 177.5 ms, max: 212.0 ms) run 50 process x 1 loops (total: 50) Total average: 183.6 ms +/- 6.9 ms (min: 176.5 ms, max: 204.6 ms) [ 6/42] chameleon_v2... run 50 process x 1 loops (total: 50) Total average: 4521.1 ms +/- 65.1 ms (min: 4416.6 ms, max: 4673.9 ms) run 50 process x 1 loops (total: 50) Total average: 4420.4 ms +/- 53.6 ms (min: 4336.4 ms, max: 4587.7 ms) [ 7/42] chaos... run 50 process x 1 loops (total: 50) Total average: 212.2 ms +/- 2.0 ms (min: 209.2 ms, max: 218.1 ms) run 50 process x 1 loops (total: 50) Total average: 221.8 ms +/- 1.7 ms (min: 219.1 ms, max: 227.0 ms) [ 8/42] django_v3... run 50 process x 1 loops (total: 50) Total average: 453.2 ms +/- 3.5 ms (min: 444.9 ms, max: 459.6 ms) run 50 process x 1 loops (total: 50) Total average: 459.6 ms +/- 3.9 ms (min: 451.3 ms, max: 470.8 ms) [ 9/42] etree_generate... run 50 process x 1 loops (total: 50) Total average: 205.0 ms +/- 1.6 ms (min: 202.1 ms, max: 208.7 ms) run 50 process x 1 loops (total: 50) Total average: 194.9 ms +/- 1.0 ms (min: 192.3 ms, max: 197.2 ms) [10/42] etree_iterparse... run 50 process x 1 loops (total: 50) Total average: 187.0 ms +/- 1.5 ms (min: 184.0 ms, max: 189.0 ms) run 50 process x 1 loops (total: 50) Total average: 194.7 ms +/- 1.4 ms (min: 191.2 ms, max: 197.4 ms) [11/42] etree_parse... run 50 process x 1 loops (total: 50) Total average: 254.6 ms +/- 0.8 ms (min: 253.3 ms, max: 257.8 ms) run 50 process x 1 loops (total: 50) Total average: 263.9 ms +/- 0.7 ms (min: 262.8 ms, max: 265.6 ms) [12/42] etree_process... run 50 process x 1 loops (total: 50) Total average: 175.0 ms +/- 1.3 ms (min: 172.6 ms, max: 178.9 ms) run 50 process x 1 loops (total: 50) Total average: 169.3 ms +/- 2.7 ms (min: 166.4 ms, max: 180.6 ms) [13/42] fannkuch... run 50 process x 1 loops (total: 50) Total average: 838.2 ms +/- 10.9 ms (min: 833.2 ms, max: 888.8 ms) run 50 process x 1 loops (total: 50) Total average: 827.3 ms +/- 1.9 ms (min: 825.5 ms, max: 833.9 ms) [14/42] fastpickle... run 50 process x 1 loops (total: 50) Total average: 401.1 ms +/- 2.7 ms (min: 396.7 ms, max: 407.5 ms) run 50 process x 1 loops (total: 50) Total average: 400.4 ms +/- 2.6 ms (min: 394.3 ms, max: 406.6 ms) [15/42] fastunpickle... run 50 process x 1 loops (total: 50) Total average: 459.8 ms +/- 3.7 ms (min: 452.8 ms, max: 471.2 ms) run 50 process x 1 loops (total: 50) Total average: 464.3 ms +/- 2.9 ms (min: 457.5 ms, max: 469.9 ms) [16/42] float... run 50 process x 1 loops (total: 50) Total average: 226.1 ms +/- 3.9 ms (min: 221.8 ms, max: 243.5 ms) run 50 process x 1 loops (total: 50) Total average: 221.2 ms +/- 3.2 ms (min: 216.9 ms, max: 229.1 ms) [17/42] formatted_logging... run 50 process x 1 loops (total: 50) Total average: 269.0 ms +/- 2.2 ms (min: 262.3 ms, max: 272.9 ms) run 50 process x 1 loops (total: 50) Total average: 275.1 ms +/- 2.6 ms (min: 270.4 ms, max: 282.7 ms) [18/42] go... run 50 process x 1 loops (total: 50) Total average: 443.3 ms +/- 4.3 ms (min: 434.7 ms, max: 454.4 ms) run 50 process x 1 loops (total: 50) Total average: 439.7 ms +/- 5.3 ms (min: 430.8 ms, max: 452.9 ms) [19/42] json_dump_v2... run 50 process x 1 loops (total: 50) Total average: 2378.4 ms +/- 23.4 ms (min: 2343.1 ms, max: 2442.0 ms) run 50 process x 1 loops (total: 50) Total average: 2380.1 ms +/- 20.0 ms (min: 2342.9 ms, max: 2441.7 ms) [20/42] json_load... run 50 process x 1 loops (total: 50) Total average: 380.5 ms +/- 2.9 ms (min: 372.7 ms, max: 385.9 ms) run 50 process x 1 loops (total: 50) Total average: 372.3 ms +/- 3.0 ms (min: 365.8 ms, max: 379.0 ms) [21/42] mako_v2... run 50 process x 10 loops (total: 500) Total average: 26.8 ms +/- 0.4 ms (min: 26.2 ms, max: 27.9 ms) run 50 process x 10 loops (total: 500) Total average: 28.2 ms +/- 0.3 ms (min: 27.5 ms, max: 29.5 ms) [22/42] meteor_contest... run 50 process x 1 loops (total: 50) Total average: 167.6 ms +/- 1.3 ms (min: 165.2 ms, max: 171.0 ms) run 50 process x 1 loops (total: 50) Total average: 176.2 ms +/- 1.1 ms (min: 174.1 ms, max: 181.0 ms) [23/42] nbody... run 50 process x 1 loops (total: 50) Total average: 211.1 ms +/- 1.1 ms (min: 209.9 ms, max: 217.1 ms) run 50 process x 1 loops (total: 50) Total average: 219.9 ms +/- 2.1 ms (min: 218.4 ms, max: 233.8 ms) [24/42] normal_startup... INFO:root:Running `taskset --cpu-list 1 ../fastcall2/python -c ` 2000 times INFO:root:Running `taskset --cpu-list 1 ../ref_default/python -c ` 2000 times [25/42] nqueens... run 50 process x 1 loops (total: 50) Total average: 187.0 ms +/- 1.0 ms (min: 185.6 ms, max: 190.3 ms) run 50 process x 1 loops (total: 50) Total average: 192.1 ms +/- 1.2 ms (min: 188.5 ms, max: 195.5 ms) [26/42] pathlib... run 50 process x 10 loops (total: 500) Total average: 73.1 ms +/- 0.7 ms (min: 71.9 ms, max: 75.6 ms) run 50 process x 10 loops (total: 500) Total average: 71.5 ms +/- 0.7 ms (min: 70.2 ms, max: 73.5 ms) [27/42] pickle_dict... run 50 process x 1 loops (total: 50) Total average: 482.5 ms +/- 0.5 ms (min: 481.5 ms, max: 483.9 ms) run 50 process x 1 loops (total: 50) Total average: 490.2 ms +/- 1.0 ms (min: 488.1 ms, max: 492.5 ms) [28/42] pickle_list... run 50 process x 1 loops (total: 50) Total average: 251.3 ms +/- 1.2 ms (min: 249.1 ms, max: 254.5 ms) run 50 process x 1 loops (total: 50) Total average: 252.7 ms +/- 1.5 ms (min: 250.0 ms, max: 255.5 ms) [29/42] pidigits... run 50 process x 1 loops (total: 50) Total average: 263.7 ms +/- 0.1 ms (min: 263.5 ms, max: 264.1 ms) run 50 process x 1 loops (total: 50) Total average: 263.8 ms +/- 0.2 ms (min: 263.4 ms, max: 264.2 ms) [30/42] raytrace... run 50 process x 1 loops (total: 50) Total average: 988.6 ms +/- 9.1 ms (min: 971.7 ms, max: 1016.1 ms) run 50 process x 1 loops (total: 50) Total average: 1017.0 ms +/- 11.0 ms (min: 999.3 ms, max: 1062.9 ms) [31/42] regex_compile... run 50 process x 1 loops (total: 50) Total average: 274.1 ms +/- 1.6 ms (min: 270.6 ms, max: 279.2 ms) run 50 process x 1 loops (total: 50) Total average: 276.2 ms +/- 1.4 ms (min: 273.4 ms, max: 278.7 ms) [32/42] regex_effbot... run 50 process x 1 loops (total: 50) Total average: 45.8 ms +/- 0.8 ms (min: 44.4 ms, max: 47.8 ms) run 50 process x 1 loops (total: 50) Total average: 57.5 ms +/- 1.2 ms (min: 55.7 ms, max: 60.8 ms) [33/42] regex_v8... run 50 process x 1 loops (total: 50) Total average: 48.0 ms +/- 0.5 ms (min: 47.4 ms, max: 49.8 ms) run 50 process x 1 loops (total: 50) Total average: 48.1 ms +/- 0.4 ms (min: 47.7 ms, max: 49.7 ms) [34/42] richards... run 50 process x 1 loops (total: 50) Total average: 135.3 ms +/- 3.1 ms (min: 130.7 ms, max: 149.3 ms) run 50 process x 1 loops (total: 50) Total average: 137.7 ms +/- 2.2 ms (min: 134.4 ms, max: 144.3 ms) [35/42] silent_logging... run 50 process x 1 loops (total: 50) Total average: 56.4 ms +/- 0.7 ms (min: 54.8 ms, max: 57.7 ms) run 50 process x 1 loops (total: 50) Total average: 55.2 ms +/- 1.3 ms (min: 53.4 ms, max: 62.0 ms) [36/42] simple_logging... run 50 process x 1 loops (total: 50) Total average: 229.5 ms +/- 2.0 ms (min: 225.3 ms, max: 235.4 ms) run 50 process x 1 loops (total: 50) Total average: 232.0 ms +/- 2.2 ms (min: 226.8 ms, max: 236.8 ms) [37/42] spectral_norm... run 50 process x 1 loops (total: 50) Total average: 214.1 ms +/- 1.4 ms (min: 212.5 ms, max: 218.8 ms) run 50 process x 1 loops (total: 50) Total average: 216.9 ms +/- 5.2 ms (min: 212.7 ms, max: 230.6 ms) [38/42] startup_nosite... INFO:root:Running `taskset --cpu-list 1 ../fastcall2/python -S -c ` 4000 times INFO:root:Running `taskset --cpu-list 1 ../ref_default/python -S -c ` 4000 times [39/42] telco... run 50 process x 1 loops (total: 50) Total average: 10.3 ms +/- 0.1 ms (min: 10.1 ms, max: 10.6 ms) run 50 process x 1 loops (total: 50) Total average: 11.1 ms +/- 0.1 ms (min: 11.0 ms, max: 11.6 ms) [40/42] tornado_http... run 50 process x 2 loops (total: 100) Total average: 224.3 ms +/- 1.8 ms (min: 220.5 ms, max: 227.2 ms) run 50 process x 2 loops (total: 100) Total average: 226.5 ms +/- 1.8 ms (min: 222.4 ms, max: 230.5 ms) [41/42] unpack_sequence... run 50 process x 10000 loops (total: 500000) Total average: 0.0 ms +/- 0.0 ms (min: 0.0 ms, max: 0.4 ms) run 50 process x 10000 loops (total: 500000) Total average: 0.0 ms +/- 0.0 ms (min: 0.0 ms, max: 0.4 ms) [42/42] unpickle_list... run 50 process x 1 loops (total: 50) Total average: 211.7 ms +/- 1.9 ms (min: 208.0 ms, max: 216.7 ms) run 50 process x 1 loops (total: 50) Total average: 208.6 ms +/- 1.8 ms (min: 205.4 ms, max: 212.3 ms) Report on Linux smithers 4.4.9-300.fc23.x86_64 #1 SMP Wed May 4 23:56:27 UTC 2016 x86_64 x86_64 Total CPU cores: 4 ### call_method ### Avg: 0.268077 +/- 0.002241 -> 0.260010 +/- 0.00118: 1.03x faster Significant (t=38.98) ### call_method_slots ### Avg: 0.271356 +/- 0.002348 -> 0.260515 +/- 0.00089: 1.04x faster Significant (t=52.89) ### call_method_unknown ### Avg: 0.273624 +/- 0.002053 -> 0.266512 +/- 0.00283: 1.03x faster Significant (t=24.91) ### call_simple ### Avg: 0.183569 +/- 0.006877 -> 0.188456 +/- 0.00898: 1.03x slower Significant (t=-3.06) ### chameleon_v2 ### Avg: 4.420450 +/- 0.053566 -> 4.521107 +/- 0.06510: 1.02x slower Significant (t=-8.44) ### chaos ### Avg: 0.221757 +/- 0.001738 -> 0.212242 +/- 0.00196: 1.04x faster Significant (t=25.70) ### etree_generate ### Avg: 0.194878 +/- 0.001025 -> 0.204999 +/- 0.00165: 1.05x slower Significant (t=-36.90) ### etree_iterparse ### Avg: 0.194734 +/- 0.001394 -> 0.186965 +/- 0.00153: 1.04x faster Significant (t=26.55) ### etree_parse ### Avg: 0.263888 +/- 0.000702 -> 0.254610 +/- 0.00085: 1.04x faster Significant (t=59.57) ### etree_process ### Avg: 0.169270 +/- 0.002704 -> 0.175002 +/- 0.00126: 1.03x slower Significant (t=-13.59) ### float ### Avg: 0.221222 +/- 0.003243 -> 0.226130 +/- 0.00390: 1.02x slower Significant (t=-6.85) ### formatted_logging ### Avg: 0.275051 +/- 0.002643 -> 0.268975 +/- 0.00224: 1.02x faster Significant (t=12.41) ### json_load ### Avg: 0.372290 +/- 0.002968 -> 0.380514 +/- 0.00289: 1.02x slower Significant (t=-14.03) ### mako_v2 ### Avg: 0.028231 +/- 0.000332 -> 0.026814 +/- 0.00035: 1.05x faster Significant (t=65.44) ### meteor_contest ### Avg: 0.176151 +/- 0.001109 -> 0.167600 +/- 0.00127: 1.05x faster Significant (t=35.90) ### nbody ### Avg: 0.219933 +/- 0.002116 -> 0.211124 +/- 0.00111: 1.04x faster Significant (t=26.05) ### nqueens ### Avg: 0.192083 +/- 0.001215 -> 0.187039 +/- 0.00104: 1.03x faster Significant (t=22.30) ### pathlib ### Avg: 0.071473 +/- 0.000701 -> 0.073063 +/- 0.00067: 1.02x slower Significant (t=-25.92) ### raytrace ### Avg: 1.016993 +/- 0.011008 -> 0.988582 +/- 0.00914: 1.03x faster Significant (t=14.04) ### regex_effbot ### Avg: 0.057531 +/- 0.001176 -> 0.045755 +/- 0.00082: 1.26x faster Significant (t=58.03) ### silent_logging ### Avg: 0.055194 +/- 0.001265 -> 0.056413 +/- 0.00069: 1.02x slower Significant (t=-5.99) ### telco ### Avg: 0.011104 +/- 0.000105 -> 0.010311 +/- 0.00008: 1.08x faster Significant (t=42.74) ### unpack_sequence ### Avg: 0.000045 +/- 0.000001 -> 0.000042 +/- 0.00000: 1.07x faster Significant (t=1607.27) The following not significant results are hidden, use -v to show them: 2to3, django_v3, fannkuch, fastpickle, fastunpickle, go, json_dump_v2, normal_startup, pickle_dict, pickle_list, pidigits, regex_compile, regex_v8, richards, simple_logging, spectral_norm, startup_nosite, tornado_http, unpickle_list. Faster (15): - regex_effbot: 1.26x faster - telco: 1.08x faster - unpack_sequence: 1.07x faster - mako_v2: 1.05x faster - meteor_contest: 1.05x faster - chaos: 1.04x faster - nbody: 1.04x faster - call_method_slots: 1.04x faster - etree_iterparse: 1.04x faster - etree_parse: 1.04x faster - call_method: 1.03x faster - raytrace: 1.03x faster - nqueens: 1.03x faster - call_method_unknown: 1.03x faster - formatted_logging: 1.02x faster Slower (8): - etree_generate: 1.05x slower - etree_process: 1.03x slower - call_simple: 1.03x slower - chameleon_v2: 1.02x slower - pathlib: 1.02x slower - float: 1.02x slower - silent_logging: 1.02x slower - json_load: 1.02x slower Not significat (19): - unpickle_list - tornado_http - startup_nosite - spectral_norm - simple_logging - richards - regex_v8 - regex_compile - pidigits - pickle_list - pickle_dict - normal_startup - json_dump_v2 - go - fastunpickle - fastpickle - fannkuch - django_v3 - 2to3 Duration: 0:54:50.250888 + echo + date jeu. mai 26 14:31:24 CEST 2016