Author vstinner
Recipients gvanrossum, mark.dickinson, methane, ned.deily, skrah, vstinner, yselivanov
Date 2018-01-26.23:16:30
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <>
> Likewise, on the same builds, running _decimal/tests/ does not show a significant difference:

Note: it may be interesting to rewrite this benchmark my perf module to be able to easily check if a benchmark result is significant.

"perf determines whether two samples differ significantly using a Student’s two-sample, two-tailed t-test with alpha equals to 0.95."


Usually, I consider that between 5% slower and 5% faster is not significant. But it depends how the benchmark was run, it depends on the type of benchmark, etc. Here I don't know so I cannot judge.

For example, for an optimization, I'm more interested by an optimization making a benchmark 10% faster ;-)
Date User Action Args
2018-01-26 23:16:30vstinnersetrecipients: + vstinner, gvanrossum, mark.dickinson, ned.deily, methane, skrah, yselivanov
2018-01-26 23:16:30vstinnersetmessageid: <>
2018-01-26 23:16:30vstinnerlinkissue32630 messages
2018-01-26 23:16:30vstinnercreate