Platforms:
Windows Vista Ultimate 64 bit
Python v3.1.2

Goal is to read a tab-separated CSV file. Some records have garbage characters in them.

The following code fragment works when the program is run in IDLE, but fails when run from the Windows command line.

...
	fh_read = open(company_info, encoding='utf_8', errors='replace')
	fh_write = open(quotes_file, 'w')
	count = 0
	try:
		rdr = csv.reader(fh_read, delimiter='\t')
		wrt = csv.writer(fh_write, delimiter='\t', quotechar='"', lineterminator='\n')
		for row in rdr:
...

Within IDLE the code works with or without the encoding='utf_8' declaration; and it fails with or without the declaration when run from the Windows command line.

The error message from the Windows command line is as follows:

'charmap' codec can't encode character '\u2019' in position 207: character maps to <undefined>

What you show is not a complete program, nor do you provide the complete traceback or the data causing the problem.  The most helpful thing would be a complete small program and data file demonstrating the problem.  That said, I'm wondering if your problem is the encoding of the terminal window.

I just now resubmitted, with a text file and program demonstrating the
problem: Issue9126.

I am new to submitting Python bug reports and I would like to do it
right. I found I could only attach 1 file to the bug report. However, I
had two files: The text file to read, and the program doing the reading.
Is there some way to attach multiple files to a bug report? If not, what
is the customary way to handle submissions where there is a file to be
processed, and a program doing the processing? And perhaps other files
exhibiting output(s)?

Thanks,

John

On Sat, 19 Jun 2010 12:48 +0000, "R. David Murray"
<report@bugs.python.org> wrote:
> 
> R. David Murray <rdmurray@bitdance.com> added the comment:
> 
> What you show is not a complete program, nor do you provide the complete
> traceback or the data causing the problem.  The most helpful thing would
> be a complete small program and data file demonstrating the problem. 
> That said, I'm wondering if your problem is the encoding of the terminal
> window.
> 
> ----------
> nosy: +r.david.murray
> 
> _______________________________________
> Python tracker <report@bugs.python.org>
> <http://bugs.python.org/issue9029>
> _______________________________________
>