+ '[' log '!=' log ']' + date jeu. mai 26 03:05:10 CEST 2016 + echo 'Original python: ../ref_default/python' Original python: ../ref_default/python + ../ref_default/python -c 'import sys; print(sys.version)' 3.6.0a1+ (default:7a7f54fe0698, May 26 2016, 01:11:44) [GCC 5.3.1 20160406 (Red Hat 5.3.1-6)] + echo + echo 'Patched python: ../default/python' Patched python: ../default/python + ../default/python -c 'import sys; print(sys.version)' 3.6.0a1+ (default:ed4eec682199, May 26 2016, 03:01:00) [GCC 5.3.1 20160406 (Red Hat 5.3.1-6)] + echo + date jeu. mai 26 03:05:10 CEST 2016 + echo + python3 -u perf.py --affinity=1 --rigorous ../ref_default/python ../default/python -b all,-hexiom2 INFO:root:Automatically selected timer: perf_counter Linux ASLR enabled? True (0) INFO:root:Skipping benchmark html5lib; not compatible with Python 3.6 INFO:root:Skipping benchmark slowspitfire; not compatible with Python 3.6 INFO:root:Skipping benchmark hg_startup; not compatible with Python 3.6 INFO:root:Skipping benchmark rietveld; not compatible with Python 3.6 INFO:root:Skipping benchmark slowunpickle; not compatible with Python 3.6 INFO:root:Skipping benchmark pybench; not compatible with Python 3.6 INFO:root:Skipping benchmark slowpickle; not compatible with Python 3.6 INFO:root:Skipping benchmark html5lib_warmup; not compatible with Python 3.6 INFO:root:Skipping benchmark bzr_startup; not compatible with Python 3.6 INFO:root:Skipping benchmark spambayes; not compatible with Python 3.6 [ 1/42] 2to3... INFO:root:Running `taskset --cpu-list 1 ../default/python lib3/2to3/2to3 -f all lib/2to3` 5 times INFO:root:Running `taskset --cpu-list 1 ../ref_default/python lib3/2to3/2to3 -f all lib/2to3` 5 times [ 2/42] call_method... run 50 process x 3 loops (total: 150) Total average: 269.4 ms +/- 0.8 ms (min: 268.6 ms, max: 273.7 ms) run 50 process x 3 loops (total: 150) Total average: 276.7 ms +/- 7.8 ms (min: 264.6 ms, max: 293.8 ms) [ 3/42] call_method_slots... run 50 process x 3 loops (total: 150) Total average: 267.2 ms +/- 1.4 ms (min: 265.7 ms, max: 274.3 ms) run 50 process x 3 loops (total: 150) Total average: 268.1 ms +/- 3.2 ms (min: 263.8 ms, max: 276.5 ms) [ 4/42] call_method_unknown... run 50 process x 3 loops (total: 150) Total average: 268.5 ms +/- 1.6 ms (min: 266.4 ms, max: 273.8 ms) run 50 process x 3 loops (total: 150) Total average: 274.3 ms +/- 2.2 ms (min: 272.0 ms, max: 280.3 ms) [ 5/42] call_simple... run 50 process x 1 loops (total: 50) Total average: 184.3 ms +/- 7.7 ms (min: 176.5 ms, max: 212.7 ms) run 50 process x 1 loops (total: 50) Total average: 198.1 ms +/- 9.8 ms (min: 189.1 ms, max: 229.1 ms) [ 6/42] chameleon_v2... run 50 process x 1 loops (total: 50) Total average: 4414.9 ms +/- 55.0 ms (min: 4340.3 ms, max: 4579.5 ms) run 50 process x 1 loops (total: 50) Total average: 4587.9 ms +/- 58.3 ms (min: 4477.1 ms, max: 4726.1 ms) [ 7/42] chaos... run 50 process x 1 loops (total: 50) Total average: 219.1 ms +/- 1.8 ms (min: 215.3 ms, max: 224.4 ms) run 50 process x 1 loops (total: 50) Total average: 236.5 ms +/- 1.6 ms (min: 233.4 ms, max: 240.0 ms) [ 8/42] django_v3... run 50 process x 1 loops (total: 50) Total average: 473.6 ms +/- 4.0 ms (min: 462.7 ms, max: 482.7 ms) run 50 process x 1 loops (total: 50) Total average: 486.2 ms +/- 3.7 ms (min: 479.2 ms, max: 493.2 ms) [ 9/42] etree_generate... run 50 process x 1 loops (total: 50) Total average: 202.3 ms +/- 1.2 ms (min: 200.1 ms, max: 204.8 ms) run 50 process x 1 loops (total: 50) Total average: 212.5 ms +/- 1.5 ms (min: 209.5 ms, max: 216.3 ms) [10/42] etree_iterparse... run 50 process x 1 loops (total: 50) Total average: 189.2 ms +/- 2.1 ms (min: 185.3 ms, max: 194.7 ms) run 50 process x 1 loops (total: 50) Total average: 187.6 ms +/- 2.2 ms (min: 183.0 ms, max: 191.4 ms) [11/42] etree_parse... run 50 process x 1 loops (total: 50) Total average: 259.2 ms +/- 0.5 ms (min: 258.4 ms, max: 260.4 ms) run 50 process x 1 loops (total: 50) Total average: 262.9 ms +/- 0.8 ms (min: 261.1 ms, max: 264.6 ms) [12/42] etree_process... run 50 process x 1 loops (total: 50) Total average: 175.9 ms +/- 1.3 ms (min: 173.5 ms, max: 180.1 ms) run 50 process x 1 loops (total: 50) Total average: 189.4 ms +/- 1.6 ms (min: 186.1 ms, max: 193.2 ms) [13/42] fannkuch... run 50 process x 1 loops (total: 50) Total average: 847.8 ms +/- 3.2 ms (min: 844.6 ms, max: 859.4 ms) run 50 process x 1 loops (total: 50) Total average: 795.5 ms +/- 11.0 ms (min: 788.5 ms, max: 838.6 ms) [14/42] fastpickle... run 50 process x 1 loops (total: 50) Total average: 407.5 ms +/- 3.3 ms (min: 402.1 ms, max: 415.2 ms) run 50 process x 1 loops (total: 50) Total average: 409.9 ms +/- 2.9 ms (min: 404.8 ms, max: 416.1 ms) [15/42] fastunpickle... run 50 process x 1 loops (total: 50) Total average: 463.4 ms +/- 2.8 ms (min: 455.2 ms, max: 468.8 ms) run 50 process x 1 loops (total: 50) Total average: 463.4 ms +/- 2.8 ms (min: 457.2 ms, max: 468.6 ms) [16/42] float... run 50 process x 1 loops (total: 50) Total average: 229.7 ms +/- 2.7 ms (min: 225.3 ms, max: 237.8 ms) run 50 process x 1 loops (total: 50) Total average: 227.8 ms +/- 4.1 ms (min: 220.6 ms, max: 239.0 ms) [17/42] formatted_logging... run 50 process x 1 loops (total: 50) Total average: 275.5 ms +/- 2.8 ms (min: 269.9 ms, max: 281.3 ms) run 50 process x 1 loops (total: 50) Total average: 301.1 ms +/- 2.8 ms (min: 294.9 ms, max: 306.9 ms) [18/42] go... run 50 process x 1 loops (total: 50) Total average: 447.6 ms +/- 5.0 ms (min: 438.7 ms, max: 459.7 ms) run 50 process x 1 loops (total: 50) Total average: 460.8 ms +/- 5.2 ms (min: 452.0 ms, max: 478.2 ms) [19/42] json_dump_v2... run 50 process x 1 loops (total: 50) Total average: 2420.8 ms +/- 23.0 ms (min: 2377.5 ms, max: 2502.2 ms) run 50 process x 1 loops (total: 50) Total average: 2462.7 ms +/- 16.5 ms (min: 2425.3 ms, max: 2495.3 ms) [20/42] json_load... run 50 process x 1 loops (total: 50) Total average: 373.2 ms +/- 2.4 ms (min: 368.3 ms, max: 380.1 ms) run 50 process x 1 loops (total: 50) Total average: 381.4 ms +/- 2.7 ms (min: 375.2 ms, max: 386.7 ms) [21/42] mako_v2... run 50 process x 10 loops (total: 500) Total average: 28.3 ms +/- 0.4 ms (min: 27.4 ms, max: 29.5 ms) run 50 process x 10 loops (total: 500) Total average: 30.4 ms +/- 0.8 ms (min: 29.3 ms, max: 33.4 ms) [22/42] meteor_contest... run 50 process x 1 loops (total: 50) Total average: 173.3 ms +/- 1.3 ms (min: 171.2 ms, max: 177.1 ms) run 50 process x 1 loops (total: 50) Total average: 175.9 ms +/- 1.1 ms (min: 173.6 ms, max: 178.6 ms) [23/42] nbody... run 50 process x 1 loops (total: 50) Total average: 218.1 ms +/- 3.5 ms (min: 215.6 ms, max: 227.1 ms) run 50 process x 1 loops (total: 50) Total average: 214.5 ms +/- 2.3 ms (min: 212.2 ms, max: 220.2 ms) [24/42] normal_startup... INFO:root:Running `taskset --cpu-list 1 ../default/python -c ` 2000 times INFO:root:Running `taskset --cpu-list 1 ../ref_default/python -c ` 2000 times [25/42] nqueens... run 50 process x 1 loops (total: 50) Total average: 190.2 ms +/- 0.7 ms (min: 188.7 ms, max: 192.2 ms) run 50 process x 1 loops (total: 50) Total average: 203.3 ms +/- 0.8 ms (min: 200.9 ms, max: 205.2 ms) [26/42] pathlib... run 50 process x 10 loops (total: 500) Total average: 71.8 ms +/- 0.8 ms (min: 70.7 ms, max: 75.7 ms) run 50 process x 10 loops (total: 500) Total average: 76.2 ms +/- 0.7 ms (min: 74.7 ms, max: 78.3 ms) [27/42] pickle_dict... run 50 process x 1 loops (total: 50) Total average: 509.2 ms +/- 1.1 ms (min: 506.1 ms, max: 511.8 ms) run 50 process x 1 loops (total: 50) Total average: 525.6 ms +/- 0.9 ms (min: 523.6 ms, max: 527.3 ms) [28/42] pickle_list... run 50 process x 1 loops (total: 50) Total average: 257.5 ms +/- 2.0 ms (min: 254.1 ms, max: 262.8 ms) run 50 process x 1 loops (total: 50) Total average: 266.4 ms +/- 1.5 ms (min: 264.1 ms, max: 270.3 ms) [29/42] pidigits... run 50 process x 1 loops (total: 50) Total average: 263.4 ms +/- 0.2 ms (min: 263.1 ms, max: 263.7 ms) run 50 process x 1 loops (total: 50) Total average: 264.5 ms +/- 0.1 ms (min: 264.3 ms, max: 265.0 ms) [30/42] raytrace... run 50 process x 1 loops (total: 50) Total average: 1034.5 ms +/- 13.8 ms (min: 1013.1 ms, max: 1090.0 ms) run 50 process x 1 loops (total: 50) Total average: 1119.1 ms +/- 10.0 ms (min: 1101.9 ms, max: 1147.5 ms) [31/42] regex_compile... run 50 process x 1 loops (total: 50) Total average: 277.8 ms +/- 1.4 ms (min: 274.9 ms, max: 281.5 ms) run 50 process x 1 loops (total: 50) Total average: 295.8 ms +/- 1.3 ms (min: 293.1 ms, max: 298.4 ms) [32/42] regex_effbot... run 50 process x 1 loops (total: 50) Total average: 44.6 ms +/- 0.2 ms (min: 44.3 ms, max: 45.1 ms) run 50 process x 1 loops (total: 50) Total average: 45.0 ms +/- 1.6 ms (min: 43.9 ms, max: 54.2 ms) [33/42] regex_v8... run 50 process x 1 loops (total: 50) Total average: 48.5 ms +/- 0.3 ms (min: 48.1 ms, max: 49.3 ms) run 50 process x 1 loops (total: 50) Total average: 49.9 ms +/- 0.4 ms (min: 49.6 ms, max: 52.1 ms) [34/42] richards... run 50 process x 1 loops (total: 50) Total average: 134.6 ms +/- 2.2 ms (min: 131.4 ms, max: 139.2 ms) run 50 process x 1 loops (total: 50) Total average: 141.8 ms +/- 1.6 ms (min: 139.5 ms, max: 146.2 ms) [35/42] silent_logging... run 50 process x 1 loops (total: 50) Total average: 57.0 ms +/- 0.9 ms (min: 55.2 ms, max: 59.3 ms) run 50 process x 1 loops (total: 50) Total average: 62.5 ms +/- 0.7 ms (min: 60.9 ms, max: 64.0 ms) [36/42] simple_logging... run 50 process x 1 loops (total: 50) Total average: 230.9 ms +/- 2.4 ms (min: 224.7 ms, max: 235.5 ms) run 50 process x 1 loops (total: 50) Total average: 256.3 ms +/- 2.7 ms (min: 249.6 ms, max: 264.3 ms) [37/42] spectral_norm... run 50 process x 1 loops (total: 50) Total average: 212.6 ms +/- 1.3 ms (min: 210.3 ms, max: 217.2 ms) run 50 process x 1 loops (total: 50) Total average: 223.4 ms +/- 3.1 ms (min: 215.9 ms, max: 229.1 ms) [38/42] startup_nosite... INFO:root:Running `taskset --cpu-list 1 ../default/python -S -c ` 4000 times INFO:root:Running `taskset --cpu-list 1 ../ref_default/python -S -c ` 4000 times [39/42] telco... run 50 process x 1 loops (total: 50) Total average: 10.7 ms +/- 0.1 ms (min: 10.6 ms, max: 10.9 ms) run 50 process x 1 loops (total: 50) Total average: 11.0 ms +/- 0.1 ms (min: 10.8 ms, max: 11.2 ms) [40/42] tornado_http... run 50 process x 2 loops (total: 100) Total average: 225.8 ms +/- 1.8 ms (min: 221.7 ms, max: 229.4 ms) run 50 process x 2 loops (total: 100) Total average: 241.3 ms +/- 2.0 ms (min: 236.7 ms, max: 245.2 ms) [41/42] unpack_sequence... run 50 process x 10000 loops (total: 500000) Total average: 0.0 ms +/- 0.0 ms (min: 0.0 ms, max: 0.1 ms) run 50 process x 10000 loops (total: 500000) Total average: 0.0 ms +/- 0.0 ms (min: 0.0 ms, max: 0.4 ms) [42/42] unpickle_list... run 50 process x 1 loops (total: 50) Total average: 216.1 ms +/- 1.2 ms (min: 213.5 ms, max: 219.6 ms) run 50 process x 1 loops (total: 50) Total average: 213.7 ms +/- 1.5 ms (min: 211.6 ms, max: 218.1 ms) Report on Linux smithers 4.4.9-300.fc23.x86_64 #1 SMP Wed May 4 23:56:27 UTC 2016 x86_64 x86_64 Total CPU cores: 4 ### 2to3 ### Avg: 5.924494 +/- 0.014282 -> 5.596081 +/- 0.02511: 1.06x faster Significant (t=25.42) ### call_method ### Avg: 0.276745 +/- 0.007811 -> 0.269439 +/- 0.00078: 1.03x faster Significant (t=11.40) ### call_method_unknown ### Avg: 0.274288 +/- 0.002159 -> 0.268471 +/- 0.00161: 1.02x faster Significant (t=26.45) ### call_simple ### Avg: 0.198085 +/- 0.009781 -> 0.184308 +/- 0.00772: 1.07x faster Significant (t=7.82) ### chameleon_v2 ### Avg: 4.587876 +/- 0.058322 -> 4.414877 +/- 0.05495: 1.04x faster Significant (t=15.27) ### chaos ### Avg: 0.236472 +/- 0.001581 -> 0.219100 +/- 0.00185: 1.08x faster Significant (t=50.50) ### django_v3 ### Avg: 0.486187 +/- 0.003702 -> 0.473604 +/- 0.00398: 1.03x faster Significant (t=16.38) ### etree_generate ### Avg: 0.212530 +/- 0.001528 -> 0.202338 +/- 0.00115: 1.05x faster Significant (t=37.68) ### etree_process ### Avg: 0.189396 +/- 0.001581 -> 0.175873 +/- 0.00134: 1.08x faster Significant (t=46.17) ### fannkuch ### Avg: 0.795527 +/- 0.010966 -> 0.847763 +/- 0.00319: 1.07x slower Significant (t=-32.34) ### formatted_logging ### Avg: 0.301103 +/- 0.002760 -> 0.275468 +/- 0.00284: 1.09x faster Significant (t=45.75) ### go ### Avg: 0.460776 +/- 0.005155 -> 0.447597 +/- 0.00498: 1.03x faster Significant (t=13.01) ### json_load ### Avg: 0.381448 +/- 0.002720 -> 0.373241 +/- 0.00241: 1.02x faster Significant (t=15.96) ### mako_v2 ### Avg: 0.030396 +/- 0.000815 -> 0.028323 +/- 0.00039: 1.07x faster Significant (t=51.27) ### nqueens ### Avg: 0.203265 +/- 0.000848 -> 0.190242 +/- 0.00068: 1.07x faster Significant (t=84.55) ### pathlib ### Avg: 0.076184 +/- 0.000713 -> 0.071771 +/- 0.00083: 1.06x faster Significant (t=63.79) ### pickle_dict ### Avg: 0.525592 +/- 0.000916 -> 0.509164 +/- 0.00114: 1.03x faster Significant (t=79.58) ### pickle_list ### Avg: 0.266440 +/- 0.001455 -> 0.257490 +/- 0.00201: 1.03x faster Significant (t=25.51) ### raytrace ### Avg: 1.119112 +/- 0.009976 -> 1.034505 +/- 0.01382: 1.08x faster Significant (t=35.10) ### regex_compile ### Avg: 0.295824 +/- 0.001265 -> 0.277794 +/- 0.00136: 1.06x faster Significant (t=68.75) ### regex_v8 ### Avg: 0.049923 +/- 0.000415 -> 0.048493 +/- 0.00028: 1.03x faster Significant (t=20.25) ### richards ### Avg: 0.141784 +/- 0.001594 -> 0.134591 +/- 0.00219: 1.05x faster Significant (t=18.76) ### silent_logging ### Avg: 0.062515 +/- 0.000676 -> 0.056983 +/- 0.00087: 1.10x faster Significant (t=35.56) ### simple_logging ### Avg: 0.256326 +/- 0.002710 -> 0.230918 +/- 0.00237: 1.11x faster Significant (t=49.87) ### spectral_norm ### Avg: 0.223381 +/- 0.003069 -> 0.212598 +/- 0.00133: 1.05x faster Significant (t=22.79) ### telco ### Avg: 0.010962 +/- 0.000122 -> 0.010724 +/- 0.00007: 1.02x faster Significant (t=11.87) ### tornado_http ### Avg: 0.241275 +/- 0.001953 -> 0.225764 +/- 0.00179: 1.07x faster Significant (t=58.54) ### unpack_sequence ### Avg: 0.000047 +/- 0.000001 -> 0.000042 +/- 0.00000: 1.11x faster Significant (t=2890.31) The following not significant results are hidden, use -v to show them: call_method_slots, etree_iterparse, etree_parse, fastpickle, fastunpickle, float, json_dump_v2, meteor_contest, nbody, normal_startup, pidigits, regex_effbot, startup_nosite, unpickle_list. Faster (27): - unpack_sequence: 1.11x faster - simple_logging: 1.11x faster - silent_logging: 1.10x faster - formatted_logging: 1.09x faster - raytrace: 1.08x faster - chaos: 1.08x faster - etree_process: 1.08x faster - call_simple: 1.07x faster - mako_v2: 1.07x faster - tornado_http: 1.07x faster - nqueens: 1.07x faster - regex_compile: 1.06x faster - pathlib: 1.06x faster - 2to3: 1.06x faster - richards: 1.05x faster - spectral_norm: 1.05x faster - etree_generate: 1.05x faster - chameleon_v2: 1.04x faster - pickle_list: 1.03x faster - pickle_dict: 1.03x faster - regex_v8: 1.03x faster - go: 1.03x faster - call_method: 1.03x faster - django_v3: 1.03x faster - telco: 1.02x faster - json_load: 1.02x faster - call_method_unknown: 1.02x faster Slower (1): - fannkuch: 1.07x slower Not significat (14): - unpickle_list - startup_nosite - regex_effbot - pidigits - normal_startup - nbody - meteor_contest - json_dump_v2 - float - fastunpickle - fastpickle - etree_parse - etree_iterparse - call_method_slots Duration: 0:56:02.864048 + echo + date jeu. mai 26 04:01:13 CEST 2016