Message91020
An example of a case that's almost 3.5 ulps out (Python 2.6):
Python 2.6.2 (r262:71600, Jul 8 2009, 09:56:31)
[GCC 4.0.1 (Apple Inc. build 5490)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from __future__ import division
>>> m = 295147931372582273023
>>> n = 295147932265116303360
>>> m/n
0.99999999697597697
The correctly rounded result would be the float given by
0.9999999969759773. |
|
Date |
User |
Action |
Args |
2009-07-28 22:29:07 | mark.dickinson | set | recipients:
+ mark.dickinson, tim.peters, terry.reedy, christian.heimes |
2009-07-28 22:29:06 | mark.dickinson | set | messageid: <1248820146.74.0.139205839868.issue1811@psf.upfronthosting.co.za> |
2009-07-28 22:29:05 | mark.dickinson | link | issue1811 messages |
2009-07-28 22:29:05 | mark.dickinson | create | |
|