`N`;dZddlmZddlmZddlmZddlmZdZ ddZ e gd Z d Z e d ge zZ d Zd ZdZdS)apComment splicer for lib2to3 trees. The lib2to3 syntax tree produced by the parser holds comments and whitespace in prefix attributes of nodes, rather than nodes themselves. This module provides functionality to splice comments out of prefixes and into nodes of their own, making them easier to process. SpliceComments(): the main function exported by this module. )pygram)pytree)token) pytree_utilscPdgt|fd|dS)a4Given a pytree, splice comments into nodes of their own right. Extract comments from the prefixes where they are housed after parsing. The prefixes that previously housed the comments become empty. Args: tree: a pytree.Node - the tree to work on. The tree is modified by this function. Nc  |jddD]P}t|tjr |)|jdr|j}|j|dz }|j }|jd}|d| d}d|vr || ddzd}d|_|j tjkrR|t|z}t!jt%|||ddn|j tjkrg}d}|dD]s}| d} | dkr ||dz }%n,|| |kr$| }|d|} ||| gf|d d |t|D]\}} } t-|| } | j tjkr t j} n t j} | t%d| dz||d | |t| z }nt3|}|D]}|j tjkrt7|t7|krt9|}t!j|jd vr@||ddz}||jdz kr|j}t!jt%||dd |n|djkr#| }|d}|drdj }|tdj!z }|t|dt|dz z }tj"tj#|dd||ff }t!j|gdd|dd}|dz }d|vrdn)|$ddz}t||dt||dz }t%|||d}t!j|||d<RdS) zfuncdefclassdeftypevaluecontext)%children isinstancerNodeprefixlstrip startswithlinenocountcolumnfindrfindrrNEWLINElenrInsertNodesAfter_CreateCommentsFromPrefixDEDENTsplitappend_FindAncestorAtIndentInsertNodesBeforejoin_FindStmtParentleavesid!_FindNodeWithStandaloneLineParentNodeNameparentrstrip splitlinesrLeafCOMMENTrindex)nodechildcomment_prefixcomment_linenocomment_column child_prefix prefix_indentcomment_groupscmtcolcomment_indent comment_groupancestor_at_indent InsertNodes stmt_parentleaf_in_parentnode_with_line_parent comment_end comment_linesr comment_leafr4comments _VisitNodeRec prev_leafs ._VisitNodeRec.sqqq!XX E6; ' 'W e <   + +C 0 0Q  <. <.*>*>t*D*DD. <. ,,T22,&'> (9(9#(>(>'>?- ] " ")-*=*=d*C*Ca*G*H*HIM%, Z5= ( ( c."7"7"9"9:: :N  ))"""$ &&&(1|  5 5 5 5 zU\)), N!N%++D11 1 1HHSMMcq!) A%.*")S>-A-A!$!$_n_!5%%~~r&JKKKR $++C0000BP 3 3= #8#O#O #(EL88*< *; k+ii ..5$$!% '''); <<< M 2 22nn 32*%00K"-"4"4"6"64 4 $ 55n%%E22 )J%(P(P%()0225LMM %~'<'+@+@+B+BBB!!(//1188>>Bvww/00vww/668899:5"""$ &&& .x??? ! qXX)_AnnotateIndents)treerJrKs @@rLSpliceCommentsrPsXf)4[[[[[[z-rMFc"g}|d}d}|t|krg}|t|kr||drr||||dz }|t|kr-||dr|r||zdz }|d|d<|d|d<t jtj d |d||ff} |s| n$t j tj j| g} || |t|krL||s2|dz }|t|kr||2|t|k|S)aGCreate pytree nodes to represent the given comment prefix. Args: comment_prefix: (unicode) the text of the comment from the node's prefix. comment_lineno: (int) the line number for the start of the comment. comment_column: (int) the column for the start of the comment. standalone: (bool) determines if the comment is standalone or not. Returns: The simple_stmt nodes if this is a standalone comment, otherwise a list of new COMMENT leafs. The prefix may consist of multiple comment blocks, separated by blank lines. Each block gets its own leaf. r rr r rr r)r%r!rrr&striprr2rr3r)rrpython_symbols simple_stmt) r7r8r9r rIlinesindex comment_block new_linenorH comment_nodes rLr#r#s((   t $ $% % E M #e**  u!4!4!6!6!A!A#!F!F 5<--//000 qje #e**  u!4!4!6!6!A!A#!F!F  $!E)A-j&q)//11mA'+1133mB[} -(( N34666l*4=\\   +l^:=:=lool### #e**  U5\%8%8%:%:  qje #e**  U5\%8%8%:%: % E * /rM) suiteif_stmt while_stmtfor_stmttry_stmt with_stmtrr decorated file_inputcntj|jtvr|St |jS)zFind a node whose parent is a 'standalone line' node. See the comment above _STANDALONE_LINE_NODES for more details. Arguments: node: node to start from Returns: Suitable node that's either the node itself or one of its ancestors. )rr.r/_STANDALONE_LINE_NODESr-r5s rLr-r-s44;''+AAA K -T[ 9 99rMrTcdtj|tvr|St|jS)zFind the nearest parent of node that is a statement node. Arguments: node: node to start from Returns: Nearest parent (or node itself, if suitable). )rr._STATEMENT_NODESr*r/rds rLr*r*'s04  $444 K 4; ' ''rMc|jj|Stj|jtjj}|||r|St |j|S)aFind an ancestor of node with the given indentation. Arguments: node: node to start from. This must not be the tree root. indent: indentation string for the ancestor we're looking for. See _AnnotateIndents for more details. Returns: An ancestor node with suitable indentation. If no suitable ancestor is found, the closest ancestor to the tree root is returned. )r/rGetNodeAnnotation Annotation CHILD_INDENTrr')r5indent parent_indents rLr'r'6sg [ K0 k<*799-6#4#4]#C#C K !f 5 55rMc|j%tj|tjjd|jD]}|jtjkrmtj |tjj}|||j krtd||ftj|tjj|j t|dS)aeAnnotate the tree with child_indent annotations. A child_indent annotation on a node specifies the indentation (as a string, like " ") of its children. It is inferred from the INDENT child of a node. Arguments: tree: root of a pytree. The pytree is modified to add annotations to nodes. Raises: RuntimeError: if the tree is malformed. Nr z"inconsistent indentation for child) r/rSetNodeAnnotationrirjrrrINDENTrhr RuntimeErrorrN)rOr6 child_indents rLrNrNUs ["4)@)M#%'''}e zU\!!!3  '466l  !lek&A&A?$OOO$T<+B+O%*[222UrMN)F)__doc__lib2to3rr lib2to3.pgen2r yapf.yapflibrrPr# frozensetrcr-rfr*r'rNrMrLrxs %%%%%%llld*/----v#$$$ :::*9m_--0FF ( ( (666>rM