Index: library/token.rst =================================================================== --- library/token.rst (revision 81892) +++ library/token.rst (working copy) @@ -13,10 +13,123 @@ the language grammar. The specific numeric values which the names map to may change between Python versions. -This module also provides one data object and some functions. The functions -mirror definitions in the Python C header files. +.. data:: ENDMARKER +.. data:: NAME +.. data:: NUMBER + +.. data:: STRING + +.. data:: NEWLINE + +.. data:: INDENT + +.. data:: DEDENT + +.. data:: LPAR + +.. data:: RPAR + +.. data:: LSQB + +.. data:: RSQB + +.. data:: COLON + +.. data:: COMMA + +.. data:: SEMI + +.. data:: PLUS + +.. data:: MINUS + +.. data:: STAR + +.. data:: SLASH + +.. data:: VBAR + +.. data:: AMPER + +.. data:: LESS + +.. data:: GREATER + +.. data:: EQUAL + +.. data:: DOT + +.. data:: PERCENT + +.. data:: BACKQUOTE + +.. data:: LBRACE + +.. data:: RBRACE + +.. data:: EQEQUAL + +.. data:: NOTEQUAL + +.. data:: LESSEQUAL + +.. data:: GREATEREQUAL + +.. data:: TILDE + +.. data:: CIRCUMFLEX + +.. data:: LEFTSHIFT + +.. data:: RIGHTSHIFT + +.. data:: DOUBLESTAR + +.. data:: PLUSEQUAL + +.. data:: MINEQUAL + +.. data:: STAREQUAL + +.. data:: SLASHEQUAL + +.. data:: PERCENTEQUAL + +.. data:: AMPEREQUAL + +.. data:: VBAREQUAL + +.. data:: CIRCUMFLEXEQUAL + +.. data:: LEFTSHIFTEQUAL + +.. data:: RIGHTSHIFTEQUAL + +.. data:: DOUBLESTAREQUAL + +.. data:: DOUBLESLASH + +.. data:: DOUBLESLASHEQUAL + +.. data:: AT + +.. data:: OP + +.. data:: ERRORTOKEN + +.. data:: N_TOKENS + +.. data:: NT_OFFSET + + + + +This module also provides a mapping from numeric codes to names and some +functions. The functions mirror definitions in the Python C header files. + + .. data:: tok_name Dictionary mapping the numeric values of the constants defined in this module