Issue 41136: argparse uses default encoding when read arguments from file

classification

Title:	argparse uses default encoding when read arguments from file
Type:	enhancement	Stage:
Components:	Library (Lib)	Versions:	Python 3.10

process

Status:	open	Resolution:
Dependencies:		Superseder:
Assigned To:		Nosy List:	paul.j3, rhettinger, serhiy.storchaka
Priority:	normal	Keywords:

Created on 2020-06-27 07:13 by serhiy.storchaka, last changed 2020-06-28 20:06 by paul.j3.

Messages (1)
msg372452 - (view)	Author: Serhiy Storchaka (serhiy.storchaka) *	Date: 2020-06-27 07:13
The fromfile_prefix_chars option allows you to read arguments from file. But open() without explicit encoding is used for this. Therefore the result is depending on the current locale or the PYTHONIOENCODING environment variable. On Linux this is rare a problem, because UTF-8 is a common locale encoding, but on Windows the locale encoding is usually 8-bit and may even be not able to encode all file names. I think we need a new option to specify the encoding for files from which arguments are read.

msg372452 - (view)

Author: Serhiy Storchaka (serhiy.storchaka) * (Python committer)

Date: 2020-06-27 07:13

The fromfile_prefix_chars option allows you to read arguments from file. But open() without explicit encoding is used for this. Therefore the result is depending on the current locale or the PYTHONIOENCODING environment variable. On Linux this is rare a problem, because UTF-8 is a common locale encoding, but on Windows the locale encoding is usually 8-bit and may even be not able to encode all file names.

I think we need a new option to specify the encoding for files from which arguments are read.

History
Date	User	Action	Args
2020-06-28 20:06:57	paul.j3	set	nosy: + paul.j3
2020-06-27 07:14:37	serhiy.storchaka	link	issue41063 dependencies
2020-06-27 07:13:47	serhiy.storchaka	create