Title: IDLE: Pasted newline doesn't trigger execution when typed newline would
Type: behavior Stage: needs patch
Components: Documentation, IDLE Versions: Python 3.6, Python 3.5, Python 2.7
Status: open Resolution:
Dependencies: Superseder:
Assigned To: terry.reedy Nosy List: cben, gpolo, irdb, merwok, ppperry, roger.serwy, terry.reedy
Priority: normal Keywords: patch

Created on 2008-08-15 05:34 by terry.reedy, last changed 2016-07-21 00:55 by terry.reedy.

File name Uploaded Description Edit
fix_idleshell_paste.diff gpolo, 2009-08-01 15:24 review
Messages (10)
msg71161 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2008-08-15 05:34
Winxp, 3.0b2, but I suspect earlier as well, since reported on c.l.p.

If I paste '1+2\n' into the command window interpreter, it responds with
'3' and a new prompt.  In IDLE, the pasted \n is ignored and a typed \n
is required to trigger execution.  As a consequence, pasting multiple
statements does not work; anything after the first is ignored.

If this cannot be changed, following
	Paste            -- Insert system-wide clipboard into window
with                        (The shell will only recognize one statement)
would at least document the limitation.
msg91162 - (view) Author: Guilherme Polo (gpolo) * (Python committer) Date: 2009-08-01 15:24
This seems to be problematic in general. I have worked on a patch now,
but it fails to succeed while pasting multiple lines. The problem is
that when a second line is pasted, IDLE is still marked as "executing"
so it ends up just pasting the line without executing it.
msg114022 - (view) Author: Cherniavsky Beni (cben) * Date: 2010-08-15 23:06
There are 2 issues here:

(1) There should be a quick & obvious way to paste and run several statements.

(2) If a user types several statements and presses Enter, all should run.  The current behavior is badly broken, and pasting is just one of the ways to trigger this.  Splitting this into a new bug:

The original formulation of this bug seems to favor an xterm-like solution to (1): when you paste \n-terminated, run them immediately, as if each \n was an Enter press.

I think a more IDLEic [think "idillic" ;-)] approach to solving (1) is to solve (2): keep the behavior that pasting creates a multi-line block without executing anything, make Enter execute it all.  Benefits:

- More intuitive to users that have never pasted multiple lines into a shell terminal.
- More sensible: why should Pasting execute anything?!
- Allows editing any of the statements before running.
- Keeps all statements together for Alt+P recalling.

If there is agreement on this, then this issue requires no action beyond solving issue 9618.
msg114561 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2010-08-21 20:46
I switched to patch review because I am not sure unit test is possible.

I did not advocate a change to immediate execution in my original post. I noted that pasting multiple statements does not work and that if it cannot be made to work, the limitation should be documented. I am fine with pasting working the same as when one copies a previous statement to the current input prompt with <cursor on line>+Enter.

Issue #9618 elaborated "<statement>\n<statement> does not work" by pointing out that <simple statement>\n<simplestatement> silently ignores the second while <compoundstatement>\n<simplestatement> is reported as a syntax error. I pointed out that if <compoundstatement> does not end in \n, it really is a syntax errror for interactive mode, but even with \n\n, it still is reported as such when it is not.

So a possible revised minimal request is that an initial compound statement be executed and the rest ignored. However ....

I have discover that the elaboration is not exactly true either. msg114019 says "If you manage to type several simple statements into the prompt (by copy-pasting them, using Ctrl+J, or creative deletion), IDLE runs the first one and silently ignores the rest:" However, when I edit 'for x in []:' to 'x = 3' *after* adding '    y = 7' I get with 3.1:
>>> x
>>> y
>>> x = 3
	y = 7
>>> x
>>> 7
Somehow, both statements are executed because of the indent! This might be considered a bug as the indent should be a syntax error. Without it, the second line is ignored, as reported.

The significant difference between the (Windows) interactive interpreter and IDLE is that the II is *line* oriented* while IDLE is *statement* oriented. With II, entry (and history) is by single lines. A line entered cannot be edited and history (up/down arrow) copies a single previous line. Multiline compound statements require *manual* indentation. Rerunning (and editing) a multiline compound statement requires rerunning (and editing) each line one at a time. IDLE, allows multiline editing before the double Enter (hence the shenanigans above, impossible with II), does auto indents, and retrieves and allows editing of entire multiline statements with <cursor>+Enter.

Since the IDLE Shell operates differently from the II, it cannot and should not imitate II paste behavior. It seems to treat pasted code more-or-less the same as edited code from the keyboard, which it expects to be a statement, single-line multi-statment, or compound statement. If there is a problem, I think perhaps it is in how it handles abusively edited multiline statements. Perhaps it should always raise SyntaxError instead of silently ignoring part of the entry.
msg114562 - (view) Author: √Čric Araujo (merwok) * (Python committer) Date: 2010-08-21 20:48
Re: testability, Tarek has written tests for distutils interactive commands by monkey-patching input/raw_input. A bit ugly, but gets the job done.
msg189601 - (view) Author: Mark Lawrence (BreamoreBoy) * Date: 2013-05-19 15:29
Could we borrow code from the ipython %paste command?  This issue is also referenced from #5124.
msg189603 - (view) Author: Roger Serwy (roger.serwy) * (Python committer) Date: 2013-05-19 15:51
The core problem is that IDLE only executes the shell buffer when the <<newline-and-indent>> virtual event gets sent by physically pressing the Enter key. Pasting the clipboard contents with \n will not trigger the enter_callback function in Lib/idlelib/

The extension as part of IdleX intercepts the pasted text and splits the buffer on '\n' and then runs each line.

Mark, what you are suggesting is adding something like a "Paste and Execute" option for the shell and its right-click menu which mimics the %paste magic from IPython. That's doable.
msg254167 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2015-11-06 03:54
In #9618, it was pointed out that IDLE Shell inherits from code.InteractiveConsole, and that #7741 proposes to allow multiple statements there.

In 3.5, this example from msg114561 now gives a SyntaxError, as it should.

>>> x = 3
	y = 7

Seven years after opening this, I am more appreciative of 'enter and execute (and recall)' one statement at a time, especially for beginners.  Ditto for being able to edit a paste before executing.  So I am more inclined to just add the note to the doc (which currently says nothing about executing anyway).

Someone who wants to paste, execute, and recall multiple statements as a block, without having output interleaved, can wrap with 'if 1:'.

>>> if 1:
msg254311 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2015-11-07 22:15
ppperry, your title revision was wrong.  Multiple line statements are pasted just fine, like single line statements.  My original title was correct and the new one better exposes the essential point of this issue by elaborating 'not same as'.
msg270897 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2016-07-21 00:55
My initial experiments indicate that pasted tabs are at least sometimes treated differently, but I need to do more to be sure.
Date User Action Args
2016-07-21 00:55:49terry.reedysetmessages: + msg270897
versions: - Python 3.4
2015-11-07 22:32:36ppperrysettitle: IDLE: Pasted \n doesn't trigger execution when typed \n would -> IDLE: Pasted newline doesn't trigger execution when typed newline would
2015-11-07 22:15:24terry.reedysetnosy: + ppperry

messages: + msg254311
title: IDLE does not handles pasted multiline statements -> IDLE: Pasted \n doesn't trigger execution when typed \n would
2015-11-07 21:12:25ppperrysettitle: Pasted \n not same as typed \n -> IDLE does not handles pasted multiline statements
2015-11-06 03:54:44terry.reedysetversions: + Python 3.5, Python 3.6, - Python 3.3
messages: + msg254167

assignee: terry.reedy
components: + Documentation
stage: patch review -> needs patch
2014-12-02 04:48:30irdbsetnosy: + irdb
2014-02-03 18:28:39BreamoreBoysetnosy: - BreamoreBoy
2013-05-19 15:51:23roger.serwysetnosy: + roger.serwy

messages: + msg189603
versions: + Python 2.7, Python 3.3, Python 3.4, - Python 3.2
2013-05-19 15:29:42BreamoreBoysetnosy: + BreamoreBoy
messages: + msg189601
2012-01-21 02:32:48terry.reedylinkissue13798 superseder
2010-08-21 20:48:59merwoksetmessages: + msg114562
2010-08-21 20:46:41terry.reedysetstage: test needed -> patch review
messages: + msg114561
versions: + Python 3.2
2010-08-21 19:41:50merwoksetversions: - Python 3.0
2010-08-21 19:41:39merwoksetnosy: + merwok
2010-08-21 19:10:01terry.reedylinkissue9618 superseder
2010-08-15 23:06:35cbensetnosy: + cben
messages: + msg114022
2009-08-01 15:24:31gpolosetfiles: + fix_idleshell_paste.diff
keywords: + patch
messages: + msg91162
2009-04-26 22:12:53ajaksu2setpriority: normal
nosy: + gpolo

stage: test needed
2008-08-15 05:34:49terry.reedycreate