This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

classification
Title: plistlib can't decode date from year 0
Type: behavior Stage:
Components: Library (Lib), macOS Versions: Python 3.8
process
Status: open Resolution:
Dependencies: Superseder:
Assigned To: Nosy List: christian.heimes, ned.deily, ronaldoussoren, shields-fn
Priority: normal Keywords:

Created on 2020-06-22 22:42 by shields-fn, last changed 2022-04-11 14:59 by admin.

Messages (5)
msg372131 - (view) Author: Michael Shields (shields-fn) Date: 2020-06-22 22:42
On macOS 10.5.5:

/tmp $ defaults export com.apple.security.KCN -
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
        <key>absentCircleWithNoReason</key>
        <false/>
        <key>applicationDate</key>
        <date>0000-12-30T00:00:00Z</date>
        <key>lastCircleStatus</key>
        <integer>-1</integer>
        <key>lastWritten</key>
        <date>2019-10-15T17:23:33Z</date>
        <key>pendingApplicationReminder</key>
        <date>4001-01-01T00:00:00Z</date>
        <key>pendingApplicationReminderInterval</key>
        <integer>86400</integer>
</dict>
</plist>
/tmp $ cat plist_date_reduction.py 
#!/usr/bin/env python3

import plistlib
import subprocess

if __name__ == "__main__":
    plist = subprocess.check_output(["defaults", "export", "com.apple.security.KCN", "-"])
    print(plistlib.loads(plist, fmt=plistlib.FMT_XML))
/tmp $ python3.8 plist_date_reduction.py 
Traceback (most recent call last):
  File "plist_date_reduction.py", line 8, in <module>
    print(plistlib.loads(plist, fmt=plistlib.FMT_XML))
  File "/usr/local/Cellar/python@3.8/3.8.3/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 1000, in loads
    return load(
  File "/usr/local/Cellar/python@3.8/3.8.3/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 992, in load
    return p.parse(fp)
  File "/usr/local/Cellar/python@3.8/3.8.3/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 288, in parse
    self.parser.ParseFile(fileobj)
  File "/private/tmp/python@3.8-20200527-50093-16hak5w/Python-3.8.3/Modules/pyexpat.c", line 461, in EndElement
  File "/usr/local/Cellar/python@3.8/3.8.3/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 300, in handle_end_element
    handler()
  File "/usr/local/Cellar/python@3.8/3.8.3/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 376, in end_date
    self.add_object(_date_from_string(self.get_data()))
  File "/usr/local/Cellar/python@3.8/3.8.3/Frameworks/Python.framework/Versions/3.8/lib/python3.8/plistlib.py", line 254, in _date_from_string
    return datetime.datetime(*lst)
ValueError: year 0 is out of range
msg372151 - (view) Author: Christian Heimes (christian.heimes) * (Python committer) Date: 2020-06-23 09:58
There is no year 0. It does not exist. The year after 1 BC is the year 1 AD.
msg372152 - (view) Author: Christian Heimes (christian.heimes) * (Python committer) Date: 2020-06-23 10:13
By the way most datetime libraries will give you incorrect values for dates before 1582, 1752, 1926, 1949 or any dates in that range depending on your country and the predominant religion of your country, county, state, or principality. Dates before 1970 are generally problematic unless the date format also references a calendar system.

It's ... messy.
msg372159 - (view) Author: Ronald Oussoren (ronaldoussoren) * (Python committer) Date: 2020-06-23 11:14
Year 0 does exist in ISO 8601 though, but that wouldn't help us here as year 0 in that standard is year 1 BCE which is not representable in Python's datetime module.

I'm not sure what we can do about this. The best we could do with plistlib is probably to add an option to either set unrepresentable dates to None or represent those dates as strings.

A more comprehensive fix is to change datetime to be able to represent these dates, but that's a much larger change that likely requires a PEP.
msg372185 - (view) Author: Michael Shields (shields-fn) Date: 2020-06-23 17:24
You're correct that there is no year 0, but as you see Apple does use <date>0000-12-30T00:00:00Z</date> in their plists. I did not set that in order to test plistlib; it's what I found on my system.

If it's a goal that plistlib be able to parse system-generated plists and round-trip them to an equivalent serialization -- and I think that should be a goal -- then using strings or None also won't work. Maybe there could be a plistlib.Datetime for dates which are outside what datetime can represent?
History
Date User Action Args
2022-04-11 14:59:32adminsetgithub: 85255
2020-06-23 17:24:51shields-fnsetmessages: + msg372185
2020-06-23 11:14:07ronaldoussorensetmessages: + msg372159
2020-06-23 10:13:36christian.heimessetmessages: + msg372152
2020-06-23 09:58:24christian.heimessetnosy: + christian.heimes
messages: + msg372151
2020-06-23 02:13:38xtreaksetnosy: + ned.deily, ronaldoussoren
components: + macOS
2020-06-22 22:42:45shields-fncreate