msg94132 - (view) |
Author: (mark.leander) |
Date: 2009-10-16 09:45 |
The datetime module documentation would imply that operations that cause
dates to fall outside the MINYEAR--MAXYEAR range should raise
OverflowError. The interpreter session below shows that this is not
always the case, and that such operations may cause bogus and
inconsistent results.
Python 2.6.3 (r263rc1:75186, Oct 2 2009, 20:40:30) [MSC v.1500 32 bit
(Intel)]
on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import datetime
>>> t0=datetime.datetime(1,1,1)
>>> d1, d2, d3 = map(datetime.timedelta, range(1,4))
# The following is expected and accoring to the docs:
>>> t0-d1
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
OverflowError: date value out of range
# The following is completely bogus:
>>> t0-d2
datetime.datetime(1, 0, 255, 0, 0)
# The two following behaving differently may be very confusing,
# the second one is correct
>>> t0-d2+d3
datetime.datetime(1, 8, 15, 0, 0)
>>> t0+d3-d2
datetime.datetime(1, 1, 2, 0, 0)
>>>
|
msg94384 - (view) |
Author: Anand B Pillai (pythonhacker) * |
Date: 2009-10-23 13:06 |
The issue is present in Python 3.0 and 2.5 as well.
Python 2.5.1 (r251:54863, Jul 17 2008, 13:21:31)
[GCC 4.3.1 20080708 (Red Hat 4.3.1-4)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import datetime
>>> t0=datetime.datetime(1,1,1)
>>> d1,d2,d3=map(datetime.timedelta, range(1,4))
>>> t0-d1
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
OverflowError: date value out of range
>>> t0-d2
datetime.datetime(1, 0, 255, 0, 0)
I think this is bug in datetime for all Python versions
|
msg94449 - (view) |
Author: Anand B Pillai (pythonhacker) * |
Date: 2009-10-25 09:29 |
The problem seems to be in the "normalize_date" function in
datetimemodule.c. It is checking for a valid year range, but not
checking for a valid month or day range.
I have a patch which fixes this problem. It checks for month range
(1<=m<=12) and day range(1<=d<=31). Here is Python with the patch.
anand@anand-laptop:~/projects/python/py3k$ ./python
Python 3.2a0 (py3k:75627, Oct 25 2009, 14:28:21)
[GCC 4.3.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.
Traceback (most recent call last):
File "/home/anand/.pythonrc", line 2, in <module>
import readline
ImportError: No module named readline
>>> import datetime
>>> t0=datetime.datetime(1,1,1)
>>> d1,d2,d3=map(datetime.timedelta, range(1,4))
>>> t0-d1
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
OverflowError: date value out of range
>>> t0-d2
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
OverflowError: date value out of range
>>> t0-d3
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
OverflowError: date value out of range
>>> d0=datetime.timedelta(0)
>>> t0-d0
datetime.datetime(1, 1, 1, 0, 0)
>>>
Svn diff is attached.
|
msg100102 - (view) |
Author: Amaury Forgeot d'Arc (amaury.forgeotdarc) * |
Date: 2010-02-25 20:39 |
The patch seems OK, but needs tests.
|
msg100104 - (view) |
Author: Alexander Belopolsky (Alexander.Belopolsky) |
Date: 2010-02-25 21:20 |
Given
assert(*m > 0);
assert(*d > 0);
at the end of normalize_y_m_d(), it looks like at lest 1 <=*month and 1 <=*day are redundant.
A closer look also reveals
assert(1 <= *m && *m <= 12);
in the middle of normalize_y_m_d(). This seems to leave only *day <=31 possibly relevant.
I suspect that out of bounds day surviving normalize_y_m_d() is a logical error in that function that needs to be fixed and an assert() added at the end. The proposed patch appears to cure the symptom rather than the actual flaw.
|
msg100105 - (view) |
Author: Alexander Belopolsky (Alexander.Belopolsky) |
Date: 2010-02-25 21:24 |
Aha! My reliance on asserts() was misguided. With the debug build:
>>> t0-d2
Assertion failed: (ordinal >= 1), function ord_to_ymd, file /Users/sasha/Work/python-svn/trunk/Modules/datetimemodule.c, line 269.
Abort trap
Should we reclassify this bug as a crash?
|
msg100107 - (view) |
Author: Amaury Forgeot d'Arc (amaury.forgeotdarc) * |
Date: 2010-02-25 21:57 |
No, because normally distributions do not use debug builds.
but that's the reason why tests are needed: they must pass with asserts enabled.
|
msg100118 - (view) |
Author: Alexander Belopolsky (Alexander.Belopolsky) |
Date: 2010-02-25 22:36 |
I am attaching my variant of the patch including additional unit tests.
Note that my changes make normalize_y_m_d() and normalize_date() the same, but I am leaving the current structure intact to make reviewer's job easier.
|
msg102945 - (view) |
Author: Anand B Pillai (pythonhacker) * |
Date: 2010-04-12 13:25 |
Can someone update this issue ? Is the 2nd patch tested... ?
|
msg103718 - (view) |
Author: Alexander Belopolsky (Alexander.Belopolsky) |
Date: 2010-04-20 14:27 |
My patch includes unit tests and I tested it on Mac OS X. Anand, what kind of testing do you have in mind?
|
msg106509 - (view) |
Author: Alexander Belopolsky (belopolsky) * |
Date: 2010-05-26 05:03 |
I've untabified my last patch and added a NEWS entry. I believe it is ready for commit review. Mark?
|
msg106511 - (view) |
Author: Mark Dickinson (mark.dickinson) * |
Date: 2010-05-26 07:28 |
I'll take a look at this patch later today.
|
msg106529 - (view) |
Author: Mark Dickinson (mark.dickinson) * |
Date: 2010-05-26 15:02 |
The patch looks good to me. Please apply!
|
msg106531 - (view) |
Author: Mark Dickinson (mark.dickinson) * |
Date: 2010-05-26 15:20 |
As an aside, I dislike the fact that the datetime module uses a C 'int' for date ordinals, and clearly assumes that it'll be at least 32 bits. int could be as small as 16 bits on some systems (small embedded systems?). But that's another issue.
|
msg106618 - (view) |
Author: Alexander Belopolsky (belopolsky) * |
Date: 2010-05-27 22:08 |
Committed in r81566 (trunk), r81568 (py3k), r81569 (release26-maint), r81570 (release31-maint).
|
|
Date |
User |
Action |
Args |
2022-04-11 14:56:54 | admin | set | github: 51399 |
2010-09-23 22:31:45 | amaury.forgeotdarc | link | issue9888 superseder |
2010-05-27 22:08:58 | belopolsky | set | status: open -> closed
messages:
+ msg106618 stage: commit review -> resolved |
2010-05-26 15:20:26 | mark.dickinson | set | messages:
+ msg106531 |
2010-05-26 15:02:40 | mark.dickinson | set | assignee: mark.dickinson -> belopolsky resolution: accepted messages:
+ msg106529 |
2010-05-26 07:28:37 | mark.dickinson | set | assignee: belopolsky -> mark.dickinson messages:
+ msg106511 |
2010-05-26 05:03:11 | belopolsky | set | files:
+ issue7150a.diff
nosy:
+ mark.dickinson messages:
+ msg106509
stage: patch review -> commit review |
2010-05-26 00:55:33 | belopolsky | set | assignee: belopolsky nosy:
+ belopolsky, - Alexander.Belopolsky |
2010-04-20 14:27:56 | Alexander.Belopolsky | set | messages:
+ msg103718 versions:
+ Python 2.7, Python 3.2, Python 3.3 |
2010-04-12 13:25:34 | pythonhacker | set | messages:
+ msg102945 |
2010-02-25 22:36:50 | Alexander.Belopolsky | set | files:
+ issue7150.diff keywords:
+ patch messages:
+ msg100118
|
2010-02-25 21:57:27 | amaury.forgeotdarc | set | messages:
+ msg100107 |
2010-02-25 21:24:53 | Alexander.Belopolsky | set | messages:
+ msg100105 |
2010-02-25 21:20:36 | Alexander.Belopolsky | set | nosy:
+ Alexander.Belopolsky messages:
+ msg100104
|
2010-02-25 20:39:23 | amaury.forgeotdarc | set | nosy:
+ amaury.forgeotdarc
messages:
+ msg100102 stage: patch review |
2009-10-25 09:29:51 | pythonhacker | set | files:
+ datetimemodule.c.svndiff
messages:
+ msg94449 |
2009-10-23 13:06:01 | pythonhacker | set | nosy:
+ pythonhacker messages:
+ msg94384
|
2009-10-16 09:45:28 | mark.leander | create | |