`N`!dZddlmZddlmZddlmZddlmZddlmZGddeZe hd Z d Z d Z d Z d ZdZdZdZdZdZdZGddeZdS)aImplements a format decision state object that manages whitespace decisions. Each token is processed one at a time, at which point its whitespace formatting decisions are made. A graph of potential whitespace formattings is created, where each node in the graph is a format decision state object. The heuristic tries formatting the token with and without a newline before it to determine which one has the least penalty. Therefore, the format decision state object for each decision needs to be its own unique copy. Once the heuristic determines the best formatting, it makes a non-dry run pass through the code to commit the whitespace formatting. FormatDecisionState: main class exported by this module. ) format_token) object_state) split_penalty)style)unwrapped_lineceZdZdZdZdZdZdZdZdZ dZ d Z dd Z d Z d ZdZdZdZdZdZdZdZdZdZdZdS)FormatDecisionStateaThe current state when indenting an unwrapped line. The FormatDecisionState object is meant to be copied instead of referenced. Attributes: first_indent: The indent of the first token. column: The number of used columns in the current line. line: The unwrapped line we're currently processing. next_token: The next token to be formatted. paren_level: The level of nesting inside (), [], and {}. lowest_level_on_line: The lowest paren_level on the current line. stack: A stack (of _ParenState) keeping track of properties applying to parenthesis levels. comp_stack: A stack (of ComprehensionState) keeping track of properties applying to comprehensions. param_list_stack: A stack (of ParameterListState) keeping track of properties applying to function parameter lists. ignore_stack_for_comparison: Ignore the stack of _ParenState for state comparison. column_limit: The column limit specified by the style. c|j|_||_||_d|_d|_d|_t||g|_g|_ g|_ ||_ tj d|_dS)aInitializer. Initializes to the state after placing the first token from 'line' at 'first_indent'. Arguments: line: (UnwrappedLine) The unwrapped line we're currently processing. first_indent: (int) The indent of the first token. rF COLUMN_LIMITN)first next_tokencolumnline paren_levellowest_level_on_lineignore_stack_for_comparison _ParenStatestack comp_stackparam_list_stack first_indentrGet column_limit)selfrrs Blib/python3.11/site-packages/yapf/yapflib/format_decision_state.py__init__zFormatDecisionState.__init__;svjDODKDID !D',D$lL99:DJDOD$D .11Dct|j|j}|j|_|j|_|j|_|j|_|jj|j_|j|_|j|_|j|_d|j D|_ d|j D|_ d|j D|_ |S)z$Clones a FormatDecisionState object.c6g|]}|SClone.0states r z-FormatDecisionState.Clone..\s 7775777rc6g|]}|Sr r!r#s rr&z-FormatDecisionState.Clone..]s AAAekkmmAAArc6g|]}|Sr r!r#s rr&z-FormatDecisionState.Clone..^s MMMeEKKMMMMMr) r rrr rrdepthrrrrr)rnews rr"zFormatDecisionState.CloneQs di): ; ;C_CNCJyCH&COY_CHN#8C&*&FC#(C77DJ777CIAAAAACNMMt7LMMMC Jrc2|j|jko|j|jkow|j|jkog|jj|jjkoM|j|jko=|jp6|jp/|j|jko|j|jko|j |j kSN) r rrrr)rrrrrrothers r__eq__zFormatDecisionState.__eq__as Ou/ / > K5< ' >   1 1 > IOuz/ / >  %)C C  >  -=  .=26* 2K3= _ 0 03=  "e&< <?rc||k Sr,r r-s r__ne__zFormatDecisionState.__ne__ou} rcft|j|j|j|jj|jfSr,)hashr rrrr)rrs r__hash__zFormatDecisionState.__hash__rs2 $+t/?$";= > >>rcd|jt|j|jdd|jDdzfzS)Nz9column::%d, next_token::%s, paren_level::%d, stack::[ %sz c34K|]}t|VdSr,)repr)r$ss r z/FormatDecisionState.__repr__..ys(55Qa555555r])rr9r rjoinrr5s r__repr__zFormatDecisionState.__repr__vsO I [$t//1A [[55$*555 5 5 ; = =>rc<|j}|j}|jrdS|sFtjj|jvr.tjj|jvrtj dsdS|s.tjj |jvrtj dsdS|rk|j dkr`|j dkrU|j}|r|j}|r |j dvrn |j}||r.tjj |jvrtj dsdS|r|j dkr |j dkrdS|j S)zDetermine if we can split before the next token. Arguments: must_split: (bool) A newline was required before this token. Returns: True if the line can be split before the next token. FALLOW_MULTILINE_DICTIONARY_KEYSALLOW_SPLIT_BEFORE_DICT_VALUE()>DOTNAME.)r previous_tokenis_pseudo_parenrSubtypeDICTIONARY_KEY_PARTsubtypesDICTIONARY_KEYrrDICTIONARY_VALUEvaluenamecan_break_before)r must_splitcurrentprevioustokenprevs rCanSplitzFormatDecisionState.CanSplit{shoG%H U 0G4DDD+73CCC I7 8 8 DU -1AAA I5 6 6 B U HNc))gms.B.B%e %# ty77 $ % <'8ENJJy899 HNc))gms.B.B U  ##rc|j}|j}|jrdS|jrdS|sdSt jdr |jdkrdSt jdrH|jdkr=t|}|sdS|jrdS||j kr| | S|j dj rg|jdvrt jds|jd vrAt jd r-tjj|jvr|jt$jkS|jd kr!|jdkrt)|j sdSt jd r4t+|jjrt1|jjsdSt jd s)t jd st jd r&|r|n|}tjj|jvr|rt jdr|rdSt7|rt9j|r|j }nt=|j }|||sd|j d_ dSnNt jd st jd r&|r|j dj St jdrT|j rMd}|jdkr?|js8t9j|s$|j}|r|j s|j!s ||rdS|j s|j"r|jdkrd}|j} |j r=| r-| j s | jdkr| j} | r| j | jdk| o | jdk}n-|j"r&| r| j"r| j} | r| j"| o | jdk}|ret9j|} | rO| jdvr|| | j sdSn(| jdkr||| j sdS|r||jdkrqtjj#|jjvrTt9j|} | r>| jdvr5tjj| jvr|||j sdSt jdrtjj#|jvr|js|jdkr|jrt|j}|rw|jdkrl|jre|jj rY|||j r>|j jr2|j jr|j jjdkrtI|rdSdSt jdrtjj%|jvrdStjj&|jvs|jr^|jdkrS|jsL|s8t|}|'|st jdS|jdkrA|j } ||| s$| jjdkrd|j d_ dSt jdr|jstjj(|jvr|jdvr|jdvrtS|s|jdkr|||j rt9j|rdSt jdst jd sdS|j*|j dj+z } | t jdkSt|}|r| | S|jdvr"|jdkr|,|rdSt jdrDt|}|r3|jr,|jj r |jdvr|j jjdkrdS|j s |jd vr|jdkrt|}|r|jdkr|jr|jj s|jjd vrd} |}|r3|jdkrd} n%|j s|jd vs |jdkrn |j}|3| r\|||j r?|j jr5|j jjdkr |j jsdS|j}|jdkrE|jdkr:|r8|j r1|j }|j}|jdkr|||sdS|j r@|r=|j r5|jdkr)|||j s t[|rt jdst jd rdSt|}|r|jdkr|jr|jj s|jjd vrd} |}|r3|jdkrd} n%|j s|jd vs |jdkrn |j}|3| r\|||j r?|j jr5|j jjdkr |j jsdS|r|s|jstjj|jvrp|r6|j!s/|j s(|}||j kr|jrdS|j}||j k|jdkr|j}|r|j s|||j rdSn|||j st]|j/d!krdS|j/|j gz}d!}|t]|kr\||d!z s'|||d!z ||sdS|d!z }|t]|k\|j0|j*z tc|j0z d"krdSn|||j sdSt jd#r|jd$vr|j2|j2krdS|jr-|j2|j2|j3d%z krdSdS)&z:Returns True if the line must split before the next token.FT SPLIT_ALL_COMMA_SEPARATED_VALUES,*SPLIT_ALL_TOP_LEVEL_COMMA_SEPARATED_VALUESz}]SPLIT_BEFORE_CLOSING_BRACKETz}])INDENT_CLOSING_BRACKETSrCSPLIT_BEFORE_FIRST_ARGUMENTDEDENT_CLOSING_BRACKETSCOALESCE_BRACKETS+SPLIT_BEFORE_EXPRESSION_AFTER_OPENING_PARENc|rJ|jdkrdS|jdkr|j S|r |jj}n|j}|JdS)z6Check if it's an expression surrounded by parentheses.rYFrC)rNr OpensScopematching_bracketrTs rSurroundedByParensz9FormatDecisionState.MustSplit..SurroundedByParensso % [C  5 [C  '' '      %*5EE$E %urrBrF%z[{ EACH_DICT_ENTRY_ON_SEPARATE_LINE{SPLIT_BEFORE_DICT_SET_GENERATORrASPLIT_BEFORE_NAMED_ASSIGNS>*:=**z:=,)CONTINUATION_INDENT_WIDTHz{)%SPLIT_ARGUMENTS_WHEN_COMMA_TERMINATEDz(,>rlrog333333?SPLIT_BEFORE_BITWISE_OPERATORz&| )4r rGrHmust_break_beforerrrN_GetOpeningBracket is_commentrd_ContainerFitsOnStartLinersplit_before_closing_bracketrrISUBSCRIPT_BRACKETrKnode_split_penaltyr UNBREAKABLE_IsSingleElementTuple_IsCompoundStatementrr _IsFunctionDef ClosesScoperc_IsLastScopeInLinerIsSurroundedByBrackets_LastTokenInLine _FitsOnLineis_name is_keyword is_stringrL_ScopeHasNoCommasDICT_SET_GENERATORrM_EachDictEntryFitsOnOneLine DEFAULT_OR_NAMED_ASSIGN_ARG_LIST_IsFunctionDefinitionr last_space_ArgumentListHasDictionaryEntry_IsFunctionCallWithArgumentslencontainer_elementsrfloatlinenocount)rrRrSopeningbracket last_tokenrfpptokenfunc_call_or_string_formattok open_bracketclosingr is_func_call ppreviousdict_endr rTelementsis r MustSplitzFormatDecisionState.MustSplitsoG%H U  T  U y34439N9N T >??;#"7++gt  u G, , ,11':::: 23G $  59-K#L#L  %  EI.G$H$H    /w7G G G)]-FFF 3!6!6 !'": ; ;"7 T  /00TY_-- 49? + +U  +,,= +,,= /00=#..00>hg   /w7G G G      = Y* + + !!## U$W-- D3G<< D 1JJ)'*BCCJ!!':66 ;?DJrN 74   i122 =i122 =8?8K8K8M8M =B< < ?@@    .C  (@ 3H== )  GO G4F   w ' ' "7,"(.C2G2G$)  c > s{ ci3&6&6# s{ ci3&6&6%(%=SY#-=""  > cm # cm %(%=SY#-=" # %S x)BCC 3H== 5)IJJ )9:: 5;B!::&%)$?@@@ @$W--  =33G<<< < T!!hn&;&; ,,W55'< T y899#7++g W+0F0N >T ! !  % 4 :c A A4 GM[88##7++g gms**w/E*  ! )+  ! '; 6 6  ' ]c ! !L ? gm{&B&Bms"" &' '  ""7G,DEE '2 '28C??+6BBDD@4'I  3!6!69!6"7)h&j  S )9)9'8)L)L t)I))*;)#x)BCC& &w / /& IC D D  I3 4 4 $W--   ,,1G,  # +-  # )[ 8 8,' )}##!l_  (D(D $$(G ) $$Wg.FGG )4 )4:cAA-8DDFFBT$g&8&8&:&:$  $.h6GGG #9/# 8I#x000   4"%x000 3  ) go   h(A B B 5 !!(H,EFF  , - - 2 250H4M3NN(!CMM!!QUO..00 $$Xa!e_hqkBB T FA CMM!! $+-t7H1I1I IC O O4(*CDD   122w}7L7L'.(( T'.7=+>+>t+D+DDDDT 5rFc||d}|r|||}n|||||z }|||z }||zS)aAdd a token to the format decision state. Allow the heuristic to try out adding the token with and without a newline. Later on, the algorithm will determine which one has the lowest penalty. Arguments: newline: (bool) Add the token on a new line if True. dry_run: (bool) Don't commit whitespace changes to the FormatToken if True. must_split: (bool) A newline was required before this token. Returns: The penalty of splitting after the current token. r)_PushParameterListState_AddTokenOnNewline_AddTokenOnCurrentLine_CalculateComprehensionState_CalculateParameterListStateMoveStateToNextToken)rnewlinedry_runrQpenaltys rAddTokenToStatez#FormatDecisionState.AddTokenToState4s   )))G+''<iffor"SPLIT_PENALTY_FOR_ADDED_LINE_SPLIT )r rG_GetNewlineColumnrrr)rrrrwrrrrrcmaxrrryrrHrNnum_line_splitsr) rrrQrRrSrrdedentrlastpprevs rrz&FormatDecisionState._AddTokenOnNewlinevs2oG%H((**DK GY_l{f ;,>!:!::: !!F"GGG  ."&+djn $ 0D9  9!)!8!D  + + - -"E 56696779f aB&/ 0 0 jn)48djn1#G nHNc$9$9 mg}M)) Z^d a )8 9 9    g 3 3 5 5%e %-2  R<rc(|j}|s3|st|j|j|_|rq|jd}tjd|j z}|j t||jdj |xjdz c_t|jdkr|rtjj|jvr#|jdj|jd_ n"|jdj |jd_ |j|xjdzc_|jod|jv}|r<|xjt|jddz c_n)|js"|xjt|jz c_|jj|_d}|jsG|js@|js9|j|jkr)|j|jz }|tjd|zz }|r2t|jdd|_|S)aCalculate format decision state information and move onto the next token. Before moving onto the next token, we first calculate the format decision state given the current token and its formatting decisions. Then the format decision state is set up so that the next token can be added. Returns: The penalty for the number of characters over the column limit. r[rprrrtrSPLIT_PENALTY_EXCESS_CHARACTER)r rcrminrrrrrrappendrrrrIrJrKrpoprrNrsplitrHis_pylint_commentis_pytype_commentis_copybara_commentr)rrRr new_indentis_multiline_stringrexcess_characterss rrz(FormatDecisionState.MoveStateToNextTokensjoG     8(;(;(=(=8"%d&?&*&6#8#8d  Z^d9899DOKj j J 20IJJKKK ! 4:w2244   1W5E E E$(JrN$9 2!!$(JrN$= 2! jnn !!+E 0E( kkS,,T2215666kkk  $( kkS'''kko0DOG  %Qg.GQ  'Q,0K$:K,K,K+(99 ;< UY<== =' /*. '&'*:::&h.??? o\3HH ""  )(G*< > >???????rc|j}|j}d}t|r|j|jdjz}|s|jd}|jru|jrn|jdj }t|j }|j} | |jt|j z z} | |jz|jkr|t jz }|S||jkr|t jz }|S|js|S|jd}||jdjkr|j|rG|jr@|jr|t jz}n)||jr|t jz }|s|jr|jr|t jz }|S|js|S|rG||jdj t|jr|t jz }|sct3jdrO|jrH||jdj kr2||jkr't8jj|jvr|t jz }|S)zMakes required changes to parameter list state. Args: newline: Whether the current token is to be added on a newline. Returns: The penalty for the token-newline combination given the current parameter state. rrr[rk) r rGrrrrr parametershas_typed_return first_tokenrrdrrNrrrVERY_STRONGLY_CONNECTEDrrrySTRONGLY_CONNECTEDLastParamFitsOnLinehas_split_before_first_paramrrrhas_default_valuesrrIPARAMETER_STARTrK) rrrRrSrr param_list last_paramrrs rrz0FormatDecisionState._CalculateParameterListStateHsoG%HGX&&#04:b>3HH *2.   =Z%@ =!,R0<*'(ABB*#0, *1C 8H4I4II I, DK '$*; ; ; }< *:+EFF H H4=33 2 ">??2%2:(+777:---,0@@@11g Nrc |dkr|Stjd}|dkr6|jjtjdztjdzS|dkr/tjd}|t ||zdz |z zS|S)NrCONTINUATION_ALIGN_STYLEFIXEDrrpz VALIGN-RIGHTrr)rrrr)int)rr align_style indent_widths r!_IndentWithContinuationAlignStylez5FormatDecisionState._IndentWithContinuationAlignStyles {{ m)677Kgy>!:!::i34456n$$Y~..l C,!6!:l JKK KK Mrc|j}|j}|jd}t|jt rdS|jdks |jjr|jS||j }| r|j r|n|j S| rl| s'|jrJ|jC|j r*td|j t!jdz S|jS|r-|jr&|jrt(jj|jvr|jSt!jdr3|r1|jdks|jrt(jj|jvr|j S|jst9|jjrt!jdst!jd rt!jd rnt=|jjj d dt!jd z}||j kr|t!jdzS|jr|jd!|j s|j |jj"d zt!jd zkrSt(jj#|jvs|jr4t(jj#|jvr|j t!jdzS|S)z%Return the new column on the newline.r[rNrpINDENT_DICTIONARY_VALUErmr_r]r^rtrrr)$r rGrrrrrdisablerrrcrrrrwrrrrrrrIrMrKrrNrHrr~r rwhitespace_prefixrSplitBeforeClosingBracketr)r)rrRrSrcont_aligned_indent token_indents rrz%FormatDecisionState._GetNewlineColumns'oG%H:b>L'0$77,Q  '! + +ty/@ +  ++@@L$($4 K $:KK/     Q  Q#+#:#F  " - - / /$G1&3N)O)OOQQ Q  ..X'G,=-1AAA _ y*++% %x~,,0H,   0G4D D D$ $  !E&:49?&K&KEi122Ei122E 0 1 1E dio/55d;;B? @ @ )N # # $ , , ,ei(CDDDD L  !" % ? ?   ! !L%1%8 Y_q EIn$=$= =&?&?   .'2B B B   C   /83D D D"UY/J%K%KKK rc|j|jz }|js|t|jz }||jz|jkS)zEDetermines if line between start and end can fit on the current line.)rrHrrNrr)rstartendlengths rrzFormatDecisionState._FitsOnLinesF   2 2F  ! EK   f DK 4#4 44rcd}d}d}|j}|j}|jj}|rL||krEtjj|jvr||}|jdkr||j}||j|sF|j|jz } | t|jz } | |j dj z|j krdS|}| r|jdks:|jr(|jjdkrtjj|jvs ||r=|jr|j}|r,||krdStjj|jvr|}n |j}|,n|j}n|j}|r||kE||}|j|jz } | t|jz } | |j dj z|j kS) z1Determine if each dict elems can fit on one line.c>|j}|jr|j}|j|Sr,)rGrw)rs rPreviousNonCommentTokenzPFormatDecisionState._EachDictEntryFitsOnOneLine..PreviousNonCommentTokens-  c N!  N! jrcbd}|jr|j}|jr|dz }|j}|j|dkS)Nrrr)rHr r)r num_stringss rImplicitStringConcatenationzTFormatDecisionState._EachDictEntryFitsOnOneLine..ImplicitStringConcatenationsLk n Mq n M1_rc|r|sdS|j}|r|jsn |j}||r |jdkrdS|j}|sdStjj|jvS)z3Return true if the dictionary value is a container.Frm)rGrHrNrrIrJrK)rrcolonkeys rDictValueIsContainerzMFormatDecisionState._EachDictEntryFitsOnOneLine..DictValueIsContainers Gu$e %$  $ %ekS((u  c u  ! 5 EErrYrFriT)rdr rrIrLrKrNrGrrrrrrcrHrM) rrrr r r entry_startrRrUrs rrz/FormatDecisionState._EachDictEntryFitsOnOneLinesF FFF &G$K +G !%g((   ,0@ @ @&&w// :  (()<==$##D$94@@ ${'??& C )** *& djn+ +t/@ @ @5     % ]c ! !%"*1*<*Bc*I*I  ! 2g6F F F ' ' 0 0G % /.G )'!!T#2g6FFF#k(G  ),''$C !%g((J&%g..G  !K$< >>rct|rx|rv|jdkr2|jj|jz }||jdjz|jkS|rn$|r|j}|j }|vdS)z?Check if the function argument list has a dictionary as an arg.rirF) _IsArgumentToFunctionrNrdrrrrrrcr )rrTrs rrz3FormatDecisionState._ArgumentListHasDictionaryEntry8sU## ! ! ;#  )69KK&$*R.//$2CC C             )(%  ! 5rcb|jj|jz |jdjz|jkS)zCheck if the container can fit on its starting line. Arguments: opening: (FormatToken) The unwrapped line we're currently processing. Returns: True if the container fits on the start line. r[)rdrrrr)rrs rrxz-FormatDecisionState._ContainerFitsOnStartLineFs6  $ 1G4H H JrN ! "&*&7 88rN)F)__name__ __module__ __qualname____doc__rr"r/r1r6r>rVrrrrrrrrrrrrrrxr rrr r $sv,222, ? ? ?>>>>>> ,$,$,$\IIIV 11118$$$LCCCJ777rCCCJ ? ? ?RRRh   777r555N?N?N?`    8 8 8 8 8rr >rdefrelifwithclasswhileexceptcB|jdkr|j}|jtvS)Nasync)rNr _COMPOUND_STMTSres rr~r~Ws$ [G  E  ''rc<|jdkr|j}|jdkS)Nrr)rNr res rrr]s$ [G  E  rcn|r2|jdkr|j}|o |jdkS|jdvrn |j}|2dS)NrBrC>rDrEEQUALF)rNr rOres rrrcs[  {ce  )u{c)) 3 3 3  E  rchtj|}|r |jdkrdS|j}|o|jS)NrBF)rrrNrGr)rTrrSs rrrnsA  1% 8 8' GMS(( 5  #(  &h&&rc|jr$|js|r|n|jS|rJ|r|j}n%|jr|j}n|r|S|j}|JdS)z5Get the opening bracket containing the current token.N)rdrHrcrrGrRs rrvrvvs Ig&=I((** H770HH%(gg  &gg      n$G % rcL|js|jr|j}|js|j|Sr,)rwr r$s rrrs;  !7#5! G  !7#5! .rcZ|j}|jdko|otjj|jvS)NrB)rGrNrrIFUNC_DEFrK)rRrUs rrrs5  $ -3  94 9   '4= 8:rcZ|j}|r!|j}|r|rdS|!dS)NFT)rdr rcr$s rrrsK  $' G7%%'' U  rc|j}|j}d}||kr9|jdkr|dz }|r|j}n|j}||k9|dkS)z%Check if it's a single-element tuple.rrYrrrdr rNrc)rTclose num_commass rr}r}ss  %  %*  {cAoj $eee  qrc|j}|j}||kr6|jdkrdS|r|j}n|j}||k6dS)z!Check if the scope has no commas.rYFTr*)rTr+s rrrse  %  %  {c U $eee  rc6eZdZdZdZdZdZdZdZdZ dS) ra Maintains the state of the bracket enclosures. A stack of _ParenState objects are kept so that we know how to indent relative to the brackets. Attributes: indent: The column position to which a specified parenthesis level needs to be indented. last_space: The column position of the last space on each level. closing_scope_indent: The column position of the closing indentation. split_before_closing_bracket: Whether a newline needs to be inserted before the closing bracket. We only want to insert a newline before the closing bracket if there also was a newline after the beginning left bracket. num_line_splits: Number of line splits this _ParenState contains already. Each subsequent line split gets an increasing penalty. cL||_||_d|_d|_d|_dS)NrF)rrrryr)rrrs rrz_ParenState.__init__s.DK DO !D(-D%Drct|j|j}|j|_|j|_|j|_|Sr,)rrrrryr)rr%s rr"z_ParenState.Clones;  T_ 5 5E!%!:E)-)JE& 0E Lrc0d|j|j|jfzS)Nz6[indent::%d, last_space::%d, closing_scope_indent::%d])rrrr5s rr>z_ParenState.__repr__s& C T_d&?GA AArcBt|t|kSr,)r4r-s rr/z_ParenState.__eq__s ::e $$rc||k Sr,r r-s rr1z_ParenState.__ne__r2rc\t|j|j|j|j|jfSr,)r4rrrryr)rargskwargss rr6z_ParenState.__hash__s5 dot/H2D4HJ K KKrN) rrrrrr"r>r/r1r6r rrrrs&AAA%%%KKKKKrrN)r yapf.yapflibrrrrrobjectr frozensetrr~rrrrvrrrr}rrr rrr:s  &%%%%%%%%%%%&&&&&&''''''l8l8l8l8l8&l8l8l8^!)DDDFF(((  '''     :::       .K.K.K.K.K&.K.K.K.K.Kr