Message405623
When I first saw "default rounding precision of 64 bits", I've thought it's about "64 bit precision", aka binary64, aka double. So I suggested that the code expects some hardly known Intel FPU-specific binary56 instead. Now, after a second paragraph of your reply I see that in reality it's about significand precision (so rounding precision of 64 bits is for binary80, and 53 is for binary64).
> at 53-bit precision (not 56-bit)
You're right. That was a typo.
Thank you for clarification, I'm closing the issue as not-a-bug. |
|
Date |
User |
Action |
Args |
2021-11-03 15:15:05 | arhadthedev | set | recipients:
+ arhadthedev, mark.dickinson |
2021-11-03 15:15:05 | arhadthedev | set | messageid: <1635952505.63.0.274372559268.issue45702@roundup.psfhosted.org> |
2021-11-03 15:15:05 | arhadthedev | link | issue45702 messages |
2021-11-03 15:15:05 | arhadthedev | create | |
|