ɭde ddlZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z m Z mZmZddlmZmZmZddlmZmZddlmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(ddl)m*Z*ddl+m,Z,dd l-m.Z.m/Z/e d Z0e1Z2e1Z3ee.e/fZ4eGd d Z5eGd dZ6eGddZ7eGddZ8de e0dee e2e0ffdZ9 d+de5de5de e.de:ddf dZ;ddde5ded ed#e6d$e1de:fd%Z?de5d&e.d$e1de:fd'Z@de5d(e.d$e1de:fd)ZAde5de>> K D| 44444rOcht|jdko|jdjtkS)z"Is this line a standalone comment?r)lenr1r?rrLs rNrSzLine.is_commentws-4;1$RQ)<@R)RRrOc`t|o|jdjtjkS)zIs this line a decorator?r)r@r1r?r&ATrYs rN is_decoratorzLine.is_decorator|s%Dzz=dk!n1UX==rOcTt|ot|jdS)zIs this an import line?r)r@rr1rYs rNrzLine.is_imports#Dzz7i A777rOcTt|ot|jdS)zIs this a with_stmt line?r)r@r!r1rYs rNr!zLine.is_with_or_async_with_stmts$DzzH8QHHHrOct|o5|jdjtjko|jdjdkS)z Is this line a class definition?rclass)r@r1r?r&NAMErArYs rNis_classz Line.is_classs@ JJ 0 A#uz1 0 A$/ rOcd|jo)|jdddtdDkS)zEIs this line a class definition with a body consisting only of "..."?NcBg|]}ttjdS.r'r&DOT.0_s rN z&Line.is_stub_class..s16 6 6 %&DC 6 6 6 rO)rbr1rangerYs rN is_stub_classzLine.is_stub_classsG} RSS!16 6 */((6 6 6 "  rOc6 |jd}n#t$rYdSwxYw |jd}n#t$rd}YnwxYw|jtjkr |jdkp8|jtjko#|duo|jtjko |jdkS)zBIs this a function definition? (Also returns True for async defs.)rFrWNdef)r1 IndexErrorr?r&rarAASYNC)rL first_leaf second_leafs rNis_defz Line.is_defs QJJ   55  *.+a.KK   KKK 5:-K*2Be2K Ou{ * +4' + EJ. +!U*  s   0 ??c|joE|jddttjdgdt dDzkS)zHIs this line a function definition with a body consisting only of "..."?N:cBg|]}ttjdSrfrhrjs rNrmz$Line.is_stub_def..s7O O O %&DC O O O rOrn)rwr1r'r&rCrorYs rN is_stub_defzLine.is_stub_defsb{ t{233/Dc4J4J3KO O */((O O O 4   rOc6t|ot|jdkor|jok|jdjt jkoK|jdjdko5|jdjt jko|jdjdkS)zzIs this a class with no base classes but using parentheses? Those are unnecessary and should be removed. (rn)) r@rXr1rbr?r&LPARrARPARrYs rNrDzLine.is_class_paren_emptys JJ ,DK  A% ,  , A#uz1 , A$+  ,  A#uz1  ,  A$+ rOc|r |jdjtjkrdS|jdj}|drdSt j|jvr|drdSdS)z#Is the line a triple quoted string?rF)z"""z'''T)zr'''zr"""zR'''zR""") r1r?r&STRINGrA startswithraccept_raw_docstringsr-)rLrAs rNis_triple_quoted_stringzLine.is_triple_quoted_strings t{1~*el::5 A$   N + + 4  (DI 5 5%:J:J ,; ; 54urOcvt|jdkrdS|jdjtjkS)z/Does this line open a new level of indentation.rF)rXr1r?r&rCrYs rN opens_blockzLine.opens_blocks4 t{  q 5{2#u{22rOfirst_leaf_matchesrct|jdkrdS|jd}|jtks|jdS|dup||jS)zIs this line converted from fmt off/skip code? If first_leaf_matches is not None, it only returns True if the first leaf of converted code matches. rWFrN)rXr1r?rfmt_pass_converted_first_leaf)rLrr7s rNis_fmt_pass_convertedzLine.is_fmt_pass_convertedsm t{  q 5{1~ I+ + +195!T) -?-?  .. .  rOc@|jD]}|jtkrdSdS)z)If so, needs to be split before emitting.TF)r1r?rrLr7s rNcontains_standalone_commentsz!Line.contains_standalone_commentss4K  Dy...tt/urOctj|jdD]W\}}|tjkrt |}t |dkr9|D]}||rdSXdS)zFChck if we have an implicit multiline string with comments on the linec|jSN)r?)r7s rNzGLine.contains_implicit_multiline_string_with_comments..sdirOrWTF) itertoolsgroupbyr1r&rlistrXcomments_after)rL leaf_typeleaf_group_iterator leaf_listr7s rN0contains_implicit_multiline_string_with_commentsz5Line.contains_implicit_multiline_string_with_commentss.7.? K/// / *I*EL((011I9~~""!  &&t,, 444  urOct} |jd}|t||jt jks|jt jkr6|js/|jd}|t|n#t$rYdSwxYwd}|j D]4\}}|D],}t|r|st|s||vrdSd}-5dS)Nrr<FT)setr1addidr?r&COMMArrArsr2itemsrr )rL ignored_ids last_leaf comment_seenleaf_idr2comments rN$contains_uncollapsable_type_commentsz)Line.contains_uncollapsable_type_commentss'ee   BI OOByMM * * *~,,%*,,Y_, !KO 9 ...   55  !%!4!4!6!6 $ $ GX# $ $"7++$#$27;;$#;66#ttt#  $usBB B.-B.cZ|jsdStd|jDd}tdt|jDd}||krP|jddD]@}|jt |gD]}t |rdSAdS)NFc3:K|]}|jdk |jVdSrNlinenorkr7s rN z9Line.contains_unsplittable_type_ignore..:s1SS4$+QRBRBR4;BRBRBRBRSSrOrc3:K|]}|jdk |jVdSrrrs rNrz9Line.contains_unsplittable_type_ignore..<s0 O OTdkQ>N>NT[>N>N>N>N O OrOr<T)r1nextreversedr2getrr )rL first_line last_linenoders rN!contains_unsplittable_type_ignorez&Line.contains_unsplittable_type_ignore)s{ 5SS4;SSSUVWW  O OXdk%:%: O O OQR    " " BCC( $ $#}00D2>>$$G-g66$#ttt$$urOc>td|jDS)Nc34K|]}t|VdSr)rrs rNrz2Line.contains_multiline_strings..Ks+EE&t,,EEEEEErO)anyr1rYs rNcontains_multiline_stringszLine.contains_multiline_stringsJs!EEEEEEEErOclosingr>c|jtvr'|jr |jdjtjksdS|jtjkrdS|jtjkr_|jV|jjtj kr<|j 5t|j ||jtj tjfrdSdS|j rdS|j t|j ||jsdSdS)aTReturn True if we have a magic trailing comma, that is when: - there's a trailing comma here - it's not a one-tuple - it's not a single-element subscript Additionally, if ensure_removable: - it's not from square bracket indexing (specifically, single-element square bracket indexing) rFTN)brackets)r?rr1r&rRBRACERSQBparentr#traileropening_bracketrLSQBr)rLrr>s rNrHzLine.has_magic_trailing_commaMs L, , ,  - B$ 335 <5< ' '4 <5: % %*N'4<77+7++K#j%*5 8u4 > 4  " .7N  #Wdk8 8 .4urOrc|jtkr"|jr d|_dS|jt jkrdS|jst|_d|_dS|jd}|jt jkr|j s|j rtt|j dkrIt|s:t|jdkrt|_d|_dS|jd}|jt!|g|dS)z0Add an inline or standalone comment to the line.Frrnrr<T)r?rr3any_open_bracketsrEr&COMMENTr1rrArrXrrr2 setdefaultrrK)rLrrs rNrJzLine.append_comment|s9 L. . .$6688 / GN5 <5= ( (5{ -GLGN5KO Nej ( (O )  )D)0022334499#G,,: 4;!##1 !#u BI   I33::7CCCtrOcR|jt|gS)z;Generate comments that should appear directly after `leaf`.)r2rrrs rNrzLine.comments_afters }  D2...rOc|j}|jt|g}|jt|jdg|dS)z@Remove the trailing comma and moves the comments attached to it.rN)r1popr2rrextend)rLtrailing_commatrailing_comma_commentss rNrIzLine.remove_trailing_commasx**"&-"3"3B~4F4F"K"K   DKO!4!4b99@@ #     rOcJ|j}|dS|j}t|tr<|jt jkrdS|jt jkrt||}|duo*td| DS)zAReturn True iff `leaf` is part of a slice with non-trivial exprs.NFc32K|]}|jtvVdSr)r?r)rkns rNrz,Line.is_complex_subscript..s;3 3 +,AF& &3 3 3 3 3 3 rO) r3 get_open_lsqb next_sibling isinstancer(r?r# listmaker subscriptlistrr pre_order)rLr7 open_lsqbsubscript_starts rNrFzLine.is_complex_subscripts(6688  5#0 ot , , G#t~55u#t'999"/"F"Fd* s3 3 0?0I0I0K0K3 3 3 0 0  rOrc#Kttttgtt t tff|rtnt}||j D]p\}}t|j t|j z}d|j vrdS| |D]}|t|j z }|||fVqdS)zReturn an enumeration of leaves with their length. Stops prematurely on multiline strings and standalone comments.  N)rrr r'rr Indexenumerate_reversed enumerater1rXrErAr)rLropindexr7lengthrs rNenumerate_with_lengthzLine.enumerate_with_lengths htn%xeTk0B'CC D"* 9     2dk?? & &KE4%%DJ7Ftz!!..t44 - -#gm,,,v% % % % % & &rOc\t|j|j|j|j|jS)N)r-r.r4r5r6)r+r-r.r4r5r6rYs rNclonez Line.clones5* 0!2!%!:     rOcV|sdSd|jz}t|j}t|}|j||j}|D]}|t |z }tj |j D]}|t |z }|dzS)zRender the line.rz ) r.iterr1rrErAstrrchain from_iterabler2values)rLindentr1firstresr7rs rN__str__z Line.__str__s 4$*$dk""V 4v4u{44  D 3t99 CC 44T]5I5I5K5KLL  G 3w<< CCTzrOc8t|jp|jS)z/Return True if the line has leaves or comments.)r@r1r2rYs rN__bool__z Line.__bool__sDK04=111rO)FFF)r:N)r:r+);__name__ __module__ __qualname____doc__rr-r__annotations__r.intrr1rr'dictr2rLeafIDrr3r4r@r5r6r rKrUpropertyrSr\rr!rbrprwr|rDrrrrrrrrrrHrJrrIrFrr rrrrrrrOrNr+r+1sEEE"""D$"""E3NNNt444FDJ444).t)D)D)DHd64:%&DDD&+eN&K&K&KO^KKK!OT!!!"d"""+/(4.///MR"%"%"%(,"%EI"% "%"%"%"%H555D5T5555(SDSSSXS>d>>>X>84888X8IDIIIXI $   X  t   X     X $ T   X   d    X      X 3T333X3IM   %-hvt|.D%E     (d $    "d""""H4BFDFFFF7<---/3- ----^#d#t####J/4/DJ////      $    & %&&& %tS() *&&&&*     2$222222rOr+cFeZdZUdZeed<eed<eed<eed<eed<dS) RHSResultz2Intermediate split result from a right hand split.headbodytailrclosing_bracketN)rrrrr+rr'rrOrNrrsK<< JJJ JJJ JJJrOrceZdZUdZeed<eded<eed<dZe ed<e e Z e eed<dZe ed <d e efd Zd S) LinesBlockzClass that holds information about a block of formatted lines. This is introduced so that the EmptyLineTracker can look behind the standalone comments and adjust their empty lines for class or def lines. r-previous_block original_linerbeforer/ content_linesafterr:ctt|j}||jzg|jz||jzgzS)N)r-)rr+r-r r r )rL empty_lines rN all_lineszLinesBlock.all_lines sE49---.. $+ % &); ;zDJ?V>W W rON)rrrrrrr r+r rrrr rrr rrrOrNrrs JJJ\****FCOOO$uT:::M49:::E3NNN 49      rOrc eZdZUdZeed<dZeeed<dZ ee ed<e e Z eeed<dZee ed<d ed e fd Zd ed eeeffd Zd ed eded eeeffdZdS)EmptyLineTrackera{Provides a stateful method that returns the number of potential extra empty lines needed before and after the currently processed line. Note: this tracker works on lines that haven't been split yet. It assumes the prefix of the first leaf consists of optional newlines. Those newlines are consumed by `maybe_empty_lines()` and included in the computation. r-N previous_linerr/ previous_defssemantic_leading_comment current_liner:c8||\}}|jr |jjnd}|jdn||z }tj|jvrV|jrO|jjCt|jjj dkr!|jjj r|j s |j sd}t|j|j|||}|jr2|j#|jjs|jjr|r|j|r||_n|jr|rd|_||_||_|S)zReturn the number of extra empty lines before and after the `current_line`. This is for separating `def`, `async def` and `class` with extra empty lines (two on module-level). rNrW)r-rr r r )_maybe_empty_linesrr rrmodule_docstring_newlinesr-rXr r1rrbrwrrSr\r)rLrr r previous_afterblocks rNmaybe_empty_linesz"EmptyLineTracker.maybe_empty_lines#sy // == 6:6IP,22q !) A.(   -1B B B# C#2:D'5<==BB#1IC!*C.:.ACF.&      " 1!)&3*+6*;A*2:f:05-* 1f 1,0D ))# rOcd}|jdkr|jjrdnd}|jr?|jd}|jd}t ||}d|_nd}t|}|j}d}|jrL|jdj|kr6|j }|jr|jdj|k6||j J|jjrH|r|j s|j j r|rdnd}nstj |jvr|jr |jsd}nO|rd}nJd}nG|rd}nB|s>|jr7|jdjt"jkr|jdjdvrd}nd}|js|j s|jr||||S|j rD|j jr8|js1|t,s||j jkr|pddfS|j r,|j jr |jrtj|jvrd S|dfStj|jvo|jdjt6kpu|jpnt;|jdoT|j oM|j jdo;|j jdjo$t?|j jdj }|j r|j jr|sd S|dfS) NrWrrrrr)withtryforwhileifmatchrrrWrr) r.r-is_pyir1rEcountminr@rrrrwr"blank_line_after_nested_stub_classrbrpr?r&rCrAr\#_maybe_empty_lines_for_class_or_defrrr$no_blank_line_before_class_docstring2allow_empty_first_line_before_new_block_or_commentrrrrr) rLr max_allowedrur user_had_newliner. previous_defis_empty_first_line_oks rNrz#EmptyLineTracker._maybe_empty_linesUs   " "#y/6!!QK   %,Q/J&,,T22F--F "J  F<<"   4T%7%;%AU%J%J-1133L  4T%7%;%AU%J%J  #%111y#  !4 9K9R "29QQFF>$)KK$-L(6LFFFFFFFF$*%+B/4 CC$+A.4MNNFFF  $  (; |?T ;;f&6    $", $!* $!66)6TT  $ +111Ka!# #   "+ 4  ;|?PPPt19   F  ! #A&+/AA +  !!4Q!788L*L*1!4L*1!4;L't'9'@'C'JKKK (   ". +  4qyrOr r-cX|js|j||jdS|jjr|jjr |jrdSdS|jj|jkr|jjs |jj rdSd}|jj r]|jj|jkrH|dkrB|j }|7|j 0|j j js|j j js|jdkr|}ndS|jjr|js |jjrI|jj|jkrd}n|jj|jkrd}n|jr|jjrd}nd}nt j|jvr|jj|jkrd}n~|j s|jr'|jj s|jrt%d|}nLd}nI|jj|jkrd}n1d}n.|jrdnd}t j|jvr|jjr|sd}|-|j }|$t+|j||jz |_d}|dfS)Nr$r#rrWr)r\rrKrr-r%rpr.rbrwrSrrr rr r+blank_line_between_nested_and_def_stub_filer'dummy_implementationsr|maxr )rLrr r-comment_to_add_newlinesslcnewlinesrs rNr)z4EmptyLineTracker._maybe_empty_lines_for_class_or_defs( 4   % %l 3 3 3   %4   * y L$> t4   #l&8 8 8   ' 9+/+=+D 948<   ) "(L,>>>! /C&2*8A3*8D3J!OO*-''t 9 . $# (:(C# %+l.@@@ HH'- 0BBB HH!/!D4F4T! HH HHC|GXXX&,|/AAA# '3'@ (/  %! #1f~~HH !HH#)L,>>>(.5qqAH-::&2;(; " .4CN)/6AANDXX(.{rO)rrrrrrrr r+rrrrrrrrr rrr@r)rrOrNrrs% JJJ$(M8D>(((+/NHZ(/// %d ; ; ;M4:;;;59hz29990d0z0000dktkc3hkkkkZ] ]*-]AE] sCx]]]]]]rOrsequencer:c#hKt|dz }t|D] }||fV|dz}dS)z;Like `reversed(enumerate(sequence))` if that were possible.rWN)rXr)r7relements rNrr"sS MMA EH%%g  rOFnew_lineold_liner1r8c|D]r}t|j|j}t|||||||D]}||dsdS)a Append leaves (taken from @old_line) to @new_line, making sure to fix the underlying Node structure where appropriate. All of the leaves in @leaves are duplicated. The duplicates are then appended to @new_line and used to replace their originals in the underlying Node structure. Any comments attached to the old leaves are reattached to the new leaves. Pre-conditions: set(@leaves) is a subset of set(@old_line.leaves). rQTN)r'r?rAr"rKr)r:r;r1r8old_leafnew_leaf comment_leafs rN append_leavesr@*s== x~66h)))|<<<$33H== = =L OOLtO < < < < = ==rOr)line_strliner-rAcz|st|}|jrtnt}tj|vr-|||jkod|vo| S|rdSd|vr|||jkS|d^}}}|||jks|||jkrdSg}d}g} tj } t|j D]\} } | tj krd} | j dzt|kr|dn/| j dzt|kr|} | %|#|j | j dzkr| j } | dkrdS| j | krV| jt"jkrAdg}|| z }| j|vr| t|j dz ks|| j xxdz cc<| tj krt)| | j } t+| r`t| dkrdS| }| }t-||vr5| ||jn|j}t-||v5t| dkrdSt1d|DS)aFor non-multiline strings, return True if `line` is no longer than `line_length`. For multiline strings, looks at the context around `line` to determine if it should be inlined or split up. Uses the provided `line_str` rendering, if any, otherwise computes a new one. rFNrWrTc3"K|] }|dkV dSrr)rkvals rNrz'is_line_short_enough..s&**Csax******rO)line_to_stringpreviewr%rXrmultiline_string_handling line_lengthrsplitmathinfrr1 bracket_depthrKrr?r&r prev_siblingr'rrrall)rBr-rAwidthrrllastcommasmultiline_stringmultiline_string_contextsmax_level_to_updateir7 had_comma ignore_ctxsctxs rNis_line_short_enoughrZBs# (!$'' .II3E(44 E(OOt/ / 8H$ 855777  ((**u 8uX$"222nnT**OEAt uU||d&&&%%++8H*H*HuF'+*,-1XT[))'!'!4 $( * *'+I!A%F 33 a    #a'#f++55"JJLL %$0$2d6H16LLL'+&8#q== 55  !4 4 4ek9Q9Q04fK 4 4K%44c$+>N>NQR>R9R9Rt)***a/*** $( * *"%&94;M"N"N  t $ $ !,--11uu# Cc((h&&)00555:%j c((h&& $%%**t **6*** * **rOc|j}t|dkrdS|djtjkr|djtjkrd}d}|d}|dddD]}|jt vr|jtvrdS|dz }nh|jtjkr|dz }nM|jtjkr'|jtjks|jt vsdSn|jtvrdS|dkr |dkrdSdS) zReturn False if the line cannot be split *for sure*. This is not an exhaustive search but a cheap heuristic that we can use to avoid some unfortunate formattings (mostly around wrapping unsplittable code in unnecessary parentheses). rFrrWrr<NT) r1rXr?r&rrirrra)rBr1 call_count dot_countrr7s rN can_be_splitr^s[F 6{{Qu ay~%%&).EI*E*E  bz26r6N  Dy,,,9$444 55a ei''Q ej(( UY..$)?O2O2O 55"222uu1}}auu 4rOrhsrIc|j}d}t|jD]K}|r ||jurd}|jt kr|sdS|s%|jt vr|j|jvr |jr|}L|j}|j sdS| }| |}|dkrdS|dkr,tj |jvr|tkr|jjrdS|t$krdSt'|jdks Jd|jd}|jd} |jt(vr"| jt vrt+|||rdS|jd } |jd } | jt,jksK| jt,jks6| jt,jkrV| jrO| jjt6jkr5| jt(vrdSt;|rdSt=|| | rdSdS) aDoes `rhs.body` have a shape safe to reformat without optional parens around it? Returns True for only a subset of potentially nice looking formattings but the point is to not return false positives that end up producing lines that are too long. NFTrWrzStranded delimiterr)rrIr<r)rQrI)rrr1rr?rrrAr3 delimitersmax_delimiter_prioritydelimiter_count_with_priorityr(wrap_multiple_context_managers_in_parensr-rrr!rrXr_can_omit_opening_parenr&rrrrr#rr_can_omit_closing_paren) r_rIrBrr7bt max_prioritydelimiter_countrsecond penultimaterQs rNcan_omit_invisible_parensrlsT 8D'+O%% # #  #t'FFF"O 9* * *? *55 # ---$ 33 4#O B =t,,..L66|DDOu!  < I I..3/5 |##t t{  q "6  KNE [^F z%%%&+=M*M*M "4u+ N N N 4 +b/K ;r?D UZ 9 $ $ I # #  $  DL00  / / /5 u % % 4 "4d L L L 4 5rOrcd}d|jz}d}|D]>\}}}|jtvr |j|urd}|r||z }||krn.|jt vrd}?t |j|dzkrdSdS) See `can_omit_invisible_parens`.Fr~rTrW)r.rr?rrrrXr1)rBrrI remainderr_indexr7 leaf_lengths rNrere&sI ^F F%)%?%?%A%A!k 9( ( (T-AU-J-JI  " k !F ##y,,,!  t{  vz ) )4 5rOrQcd|jz}d}|D]0\}}}||z }||jur |s||krdS |jtvrd}1dS)rnr~FT)r.rrr?r)rBrQrIrseen_other_bracketsrpr7rqs rNrfrf?s ^F%)%?%?%A%A''!k+ 4' ' '" f &;&;tt'<Y* * *"&  5rOcFt|dS)zmReturns the string representation of @line. WARNING: This is known to be computationally expensive. r)rrB)rBs rNrFrFPs t99??4  rOr)CrrK dataclassesrrtypingrrrrr r r r r rblack.bracketsrrr black.moderr black.nodesrrrrrrrrrrrrr r!r"r#r$ black.stringsr%blib2to3.pgen2r&blib2to3.pytreer'r(r)rrrLNr+rrrrr@r@rrZr^rlrerfrFrrOrNr~s ((((((((                        HGGGGGGGGG$$$$$$$$&$##### &&&&&&&& GCLL   4: }2}2}2}2}2}2}2 }2@            * KKKKKKK K\!%q/1JNS==="=,0J=FJ= ====202X+X+X+ X+X+),X+ X+X+X+X+v!t!!!!!Hb bb bbbbJ$$ST2$CD"!!#!!!!!!rO