xheDu dZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl Z ddl mZmZdd lmZmZmZmZmZdd lmZejjd ejjd d d d ddejddddderdndddddddddgddggddd Zdddd d!dddd d!d"d#d#d$d!d%d&d'd(d%d)d*d+d%d)d,Zejd-dd.Z ddd/d0d1d2Z!e d3d4Z"d5Z#d6Z$d7Z%d8Z& dMd:Z'dNd;Z(d<Z)d=Z*dNd>Z+dOd?Z,dPd@Z-dAZ.e d3dBZ/dCZ0e0Z1dDZ2dOdEZ3dFZ4dOdGZ5dQdIZ6e d3dQdJZ7dKZ8dLZ9dS)RziThis file handles the parsing of feature specifications from files, ending up with a configuration matrixN) OrderedDictcopy) lru_cache)product)cc_conda_buildsubdir) ensure_list get_loggerisliston_wintrim_empty_keys)_parse.z1.22z1.23z1.26)))r )r )r )r z5.26.253.43.5noconazx.x)min_pinmax_pin)pythonzr-basernumpy)pin_run_as_buildignore_versionignore_build_only_deps extend_keyszhttps://cran.r-project.org) rr perlluar_basecpu_optimization_targetr!r"r#r$ cran_mirrorvs2008vs2010vs2017)2.7z3.3rr91014gfortran)ccxxvcfortrangccgxx)r2r3r5clangclangxx)winlinuxosx-r&r%r')PYNPYLUAPERLR)maxsizect|}|dkrgt|tdkrd}n"t|tdkrd}|d||d<|d||d<d|D}|dkrt|d||d<|S) Nr:rz3.2r-r2r3c,i|]\}}|dk |dz|S)r4 _compiler).0langpkg_names 4lib/python3.11/site-packages/conda_build/variants.py z*_get_default_compilers..ls4 D( 4<< {H <<r4)DEFAULT_COMPILERSr parse_versionitems)platformpy_ver compilerss rL_get_default_compilersrUbs!(+0022I5  M%$8$8 8 8FF 6 " "mE&:&: : :F"3/ #$U+F3 %'oo//I 5+H5d;FC $ rNct}|j|d<t|dr|jds|dn |jd}|t|j||S)Ntarget_platformvariantr) DEFAULT_VARIANTSrr hasattrrXgetupdaterUrR)configbasers rLget_default_variantr_ws  " "D$mD  ** &28.2D2DX2N2N &X ^H %  KK&v??@@@ KrNc&ddlm}m}t|5}|}dddn #1swxYwY||||d}t j|t jjpi}t||S)Nr) get_selectors select_linesF)variants_in_place)Loader) metadatararbopenreadyamlloadloader BaseLoaderr)pathr]rarbfcontentscontents rLparse_config_filerps55555555 dq6688|HmmF&;&;uUUUHi)?@@@FBGG Ns 9==clg}|dD t}|fd|Dt|fd|D|fd|Dn9#t$r,}|t |Yd}~nd}~wwxYwt td|}|r6td|d |dS)Nc3*K|]}d|vd|dVdS)r=z z& key contains an invalid character '-'NrH)rIks rL z validate_spec..s;;<q6Q666rNc3<K|]}|D]}|vd|d|dVdS) zip_key entry in group z does not have any settingsNrH)rIzgrsspecs rLrtz validate_spec..s_    }} Lq K KB K K K}}}}   rNc3fK|]+}|D]&}|vr d|d|dn|V',dS)rvrwz1 is a duplicate, keys can only occur in one groupN)add)rIrxrsuniques rLrtz validate_spec..s    F{{ q  B    A        rNc3jK|]-}tfd|Ddhz dk%d|dV.dS)c`h|]*}|vr"tt|nd+SN)lenr rIrsrys rL z*validate_spec...s:NNNaa4ii[a))***TNNNrNNrz zip fields in zip_key group z are not all the same length)rrIrxrys rLrtz validate_spec..s   NNNN2NNNRVQWW NR M M M   rNz&Variant configuration errors in {}: {} ) extend _get_zip_keysset ValueErrorappendstrlistfilterformatjoin)srcryerrorszip_keyser|s ` @rL validate_specrs F MM@D $  &&                                  3  c!ffJ&v&& ' 'F   5 < z#find_config_files..s4(:(:27;M;Ma;P;P(Q(QRRrNc&g|] }|SrHrHrIrmresolves rL z%find_config_files..s! L L LAWWQZZ L L LrN config_file~zconda_build_config.yamlrlc&g|] }|SrHrHrs rLrz%find_config_files..s!OOO''!**OOOrN) r exclusive_config_filesignore_system_variantsr r[rrlrisfilergetattrrvariant_config_files)metadata_or_pathr]filescfgrlrs @rLfind_config_filesrs*SRG M L L LV-J!K!K L L LE  6   m , , H'.788CC'"',,s,EFFGGC 7>>#    LL   g/00 7>>#    LL    #V-= > >D '"',,t%>?? @ @C w~~c S LLOOOOk&2M&N&NOOOPPP LrNTcit|}t|}|D]\}r|r,tt}|d|D]\}|r|vr|vrt |drNvr2t dr|W|<otg< t|tt<dkrd|D}t|dtst|dts|g}g< |tddDD<t |dr|<g} |r |D] } | vr| } n tfd| Dr| D]} tt| tt|kr`t!d || tt|tt| t| | <vr| D]} | vrBtt| tt|krn^| vrBtt| tt|krn|<fd t|D} fd | D} t| r-t!d || | S) NzAdding in variants from keysrcg|]}||SrHrH)rIsubvals rLrz._combine_spec_dictionaries..s>>>v>V>>>rNrc34K|]}t|VdSr)r)rI set_groups rLrtz-_combine_spec_dictionaries..s<)) )!OO))))))rNc,h|]}t|SrH)tuple)rIgroups rLrz-_combine_spec_dictionaries..s-R-R-RueEll-R-R-RrNc3 K|]}|vV dSrrHrI group_itemrys rLrtz-_combine_spec_dictionaries..,s("V"V*:#5"V"V"V"V"V"VrNznAll entries associated by a zip_key field must be the same length. In {}, {} and {} are different ({} and {})c(g|]}|v |SrHrH)rIsubvaluersvaluess rLrz._combine_spec_dictionaries..Is25"5"5"(0'/vay'@'@%-'@'@'@rNcg|]}|v| SrHrHrs rLrz._combine_spec_dictionaries..Ns.7"7"7"(2'1'='=%/'='='=rNzvariant config in {} is ambiguous because it does not fully implement all zipped keys (To be clear: missing {}) or specifies a subspace that is not fully implemented (To be clear: .. we did not find {} from {} in {}:{}).)r rQr __name__inforZr\rr[rrr isinstancerallrrr)specsr$ filter_keysr log_outputr spec_sourcelogv keys_in_grouprrmissing_subvaluesmissing_group_itemsrsryrs @@@rL_combine_spec_dictionariesrs F { # #Dk**K"[[]]a&a& T ` & C **AKAABBB \ &\ &1[&qDyyK''"1f-- = F{{wvay&/I/I{ &q 0 0 3 3 3 3,-FFHHq (3FJJq"4E4E(F(FF1I"1I,,[^^<<<(,S^^(<(>!>>>)!A$55$j1u>U>U$!"A$*JJq"$5$5q q ((+++$())-R-Rq -R-R-R)))%%q #1f--B&()F1II./CM'.-5!.!.E'(Ezz8= (-(2 #"V"V"V"V "V"V"VVV4&2?!W!WJ'*;tJ7G+H+H'I'IS(3AN&N&(&(&/9-DDJF0;010:03KNN0C0C03KZ@P4Q4Q0R0R E.E. /* /* )*:ET*EU9V9VF:$6$6!W "#f2? !9 !9J'1T'9'9c(3D4D(E(E?&?&),[^^)<)<?=?=).'1V';';(3F:4F(G(GA&A&),[^^)<)<A=A=).01F1I5"5"5"5"5"4?NN5"5"5" 1 7"7"7"7"6C7"7"7" 3 $''8#9#9 !&*4)STZSY,7,?,=,0,-,21I T*T* +& +& %& MrNctddd}|d|Dt||dg|dg}t||||}|S)aWith arbitrary sets of sources, combine into a single aggregate spec. Later specs in the input set have priority and overwrite duplicate entries. specs: list of dictionaries. Keys are arbitrary, but correspond to variable names used in Jinja2 templated recipes. Values can be either single values (strings or integers), or collections (lists, tuples, sets). r$Nc`g|]+}|t|dD]}|,S)r$)r r[)rIrykeys rLrz!combine_specs..ps]    #488M#:#:;;        rNr)r$rr)r$rr)rYrrrr[)rrr$rrs rL combine_specsres#=1!!!4K      * ;ZLZ c*b ( ;jF MrNc2dtD}i}|D]\\}}||vrSt||}|dkr0d|ddd}||d|z<]|S)zGiven args passed into conda command, set language env vars to be made available. Search terms: CONDA_PY, CONDA_R, CONDA_PERL, CONDA_LUA, CONDA_NPY ci|]\}}|| SrHrHrIrsrs rLrMz)set_language_env_vars..s777DAq1a777rNr?rNrCONDA_) SUFFIX_MAPrQrrsplit)rX inverse_mapenv variant_name env_var_namevalues rLset_language_env_varsrs 87J$4$4$6$6777K C&1&7&7&9&911" l 7 " " -..Et## C 0 0! 455+0C<' ( JrNc|d}|stSt|drt|hSt|dr d|DSt d)a+ Extracts 'zip_keys' from `spec` and standardizes value into a list of zip_groups (tuples of keys (string)). :param spec: Variants specification :type spec: dict :return: Standardized 'zip_keys' value :rtype: set :raise ValueError: 'zip_keys' cannot be standardized rc,t|tSrrrrs rLrz_get_zip_keys..sJq#,>,>rNuniformc&t|dS)Nc,t|tSrrrs rLrz1_get_zip_keys....s 1c@R@RrNr)r rs rLrz_get_zip_keys..sF16R6R$S$S$SrNc,h|]}t|SrH) frozenset)rIrxs rLrz _get_zip_keys..s111" " 111rNz;'zip_keys' expect list of string or list of lists of string)r[rr rr)ryrs rLrrsxx ##H 2uu ">"> ? ? ?2(##$$ SS   2211111 R S SSrNcddh}|r |td|t|dS)a Extracts 'extend_keys' from `spec`. :param spec: Variants specification :type spec: dict :param include_defaults: Whether to include default 'extend_keys' :type include_defaults: bool, optional :return: Standardized 'extend_keys' value :rtype: set rr$)r\rYunionr r[)ryinclude_defaultsr$s rL_get_extend_keysrsX}-K<+M:;;;   [-)@)@AA B BBrNc|t|}|t|}hd}||j||S)a Keys in `spec` that are not exploded and are simply carried over from the `spec` into the variants without modification. :param spec: Variants specification :type spec: dict :param zip_keys: Keys defined as 'zip_keys' (see :func:`_get_zip_keys`) :type zip_keys: set, optional :param extend_keys: Keys defined as 'extend_keys' (see :func:`_get_extend_keys`) :type extend_keys: set, optional :return: Passthru (not exploded) keys defined in `spec` :rtype: set N>rr$ replacements)rrr difference intersection)ryrr$ passthru_keyss rL_get_passthru_keysrsa &&&t,, ???M 6=  { + + 6 A N Nt T TTrNcl|t|||}t||S)a Keys in `spec` that are that are exploding into the variants. :param spec: Variants specification :type spec: dict :param passthru_keys: Passthru (not exploded) keys (see :func:`_get_passthru_keys`) :type passthru_keys: set, optional :param zip_keys: Keys defined as 'zip_keys' (see :func:`_get_zip_keys`) and is passed to :func:`_get_passthru_keys` if `passthru_keys` is undefined :type zip_keys: set, optional :param extend_keys: Keys defined as 'extend_keys' (see :func:`_get_extend_keys`) and is passed to :func:`_get_passthru_keys` if `passthru_keys` is undefined :type extend_keys: set, optional :return: Exploded keys defined in `spec` :rtype: set )rrr)ryrrr$s rL_get_explode_keysrs5$*4;GG t99   . ..rNc Ng}t|dr|}n|D]}||-|||vr||Dtt}|d|d|d|d|||S)zvariants is the exploded out list of dicts, with one value per key in each dict. key and values come from subsequent variants before they are exploded out.rNzFiltering variant with key z not matching target value(s) (z) from z , actual )rZr[rr rdebug)variantsrr source_namereduced_variantsrXrs rLfilter_by_key_valuersvv #   G{{3+ C0@0@F0J0J ''0000 ** P#PPPP'2PP=D[[=M=MPP rNc,||Sr)r)stringchars rL _split_strrs <<  rNct}t|}fd|D}t|}fd|j|D}|fd|Dt |g}t |D]b}d|D}|dt||D| |c|S)a Helper function to explode spec into all of the variants. .. code-block:: pycon >>> spec = { ... # normal expansions ... "foo": [2.7, 3.7, 3.8], ... # zip_keys are the values that need to be exploded as a set ... "zip_keys": [["bar", "baz"], ["qux", "quux", "quuz"]], ... "bar": [1, 2, 3], ... "baz": [2, 4, 6], ... "qux": [4, 5], ... "quux": [8, 10], ... "quuz": [12, 15], ... # extend_keys are those values which we do not explode ... "extend_keys": ["corge"], ... "corge": 42, ... } >>> explode_variants(spec) [{ "foo": 2.7, "bar": 1, "baz": 2, "qux": 4, "quux": 8, "quuz": 12, "corge": 42, "zip_keys": ..., "extend_keys": ..., }, { "foo": 2.7, "bar": 1, "baz": 2, "qux": 5, "quux": 10, "quuz": 15, "corge": 42, ..., }, ...] :param spec: Specification to explode :type spec: `dict` :return: Exploded specification :rtype: `list` of `dict` cJi|]}|s |dk|| S)rrHrs rLrMz$explode_variants..1s1NNNqT!WNQ2 47 rNcRi|]#}|fdt|D$S)c0g|]}t|dS)F) include_dictr )rIrs rLrz/explode_variants...6s%PPPa{15111PPPrNrrs rLrMz$explode_variants..5sH  PP;tAw;O;OPPPrNc Vi|]%}|ttfd|D&S)c3BK|]}t|VdSrrrs rLrtz.explode_variants...:s/99 DG,,999999rN)rziprs rLrMz$explode_variants..:s=OOOT#9999b999: ; ;OOOrNc4i|]\}}|t|SrHrrs rLrMz$explode_variants..Cs$;;;$!Q1d1gg;;;rNcFi|]\}}t||D]\}}|| SrH)r)rIrxzvrsrs rLrMz$explode_variants..Es7 M M Mfb"R M MAQ M M M MrN) rrrrr\rrrrQrr) ryrrpassthru explode_keysexploderrrXs ` rLexplode_variantsr sNRT""H'tX66MNNNNMNNNH%T=99L(((3G NNOOOOhOOOG H7>>++,!!;;(..*:*:;;; M MGV 4 4 M M M        OrNc  |sdSt t}d}d|dvr|ddr|ddng}|rt|dddts't|dddtr|dd}n|ddg}|D]}|D]}|||D]*}|D]\}}|dkr t|dr= |t} | || |<Zt|trCt |tt|z |<t |gt|z |<||vr%tt | |<,|r[|D]X}tttt fd|D} t|D]\} } | |  | <Y| d< S)zOpposite of dict_of_lists_to_list_of_dicts function. Take broken out collection of variants, and squish it into a dict, where each value is a list. Only squishes string/int values; does "update" for dict keys Nrrrc3(K|] }|V dSrrH)rIrsquisheds rLrtz1list_of_dicts_to_dict_of_lists..zs'(H(H3#(H(H(H(H(H(HrN) rrrrrr{rQrZr[r\r r enumerate) list_of_dicts all_zip_keysgroupszip_key_groupsritemrXrsrexisting_valueridxrr s @rLlist_of_dicts_to_dict_of_listsrOs }}H55L F q) ) )mA.>z.J ) a$$   ' mA&z215t < < 4 ! Z ( +UA A  4#1%j1FF#A&z23F ' 'E ' '  &&&& ' 9 9MMOO 9 9DAqJq&!! 9!)a!?!?%%a(((, At$$ 9!(,,q#%%"8"899CFFB "8<<2#6#677+a..H L(("&s8A;'7'7"8"8HQK 9, , ,E#s3(H(H(H(H%(H(H(H#IJJKLLF%e,, , ,S &s   ,)HZ OrNct|dr|j}|sddlm}|}t||}t t |}|D]}t ||||<t|dr|jr |j|d<|r||d<|D]\}}t||t||j }||fS) Nr]r)Config)internal_defaultsrXzconfig.variantargument_variants)r) rZr]rrrr_rprXrQrrverbose) recipedir_or_metadatar]rrrrrmry combined_specs rLget_package_combined_specrs$h//.&- """""" 3V < rr"r!rr$cjg|].vr$tfdddD,/S)c3HK|]}|dkVdS)rNrH)rIrXrsrs rLrtz&get_vars...s4LLG71:!Q/LLLLLLrNrN)any)rIrs loop_only special_keysrs @rLrzget_vars..si L  !LLLLLx|LLLLL ! rN)r\rr r[)rr, loop_varsr-s`` @rLget_varsr/sFEELK  (F(FGGHHIII!I rNc Tt}|}|D]~gtjd}|rS|sQ|ddtjz}|fd|D}nfd|D}|stj}dttj d} d|z} d |z} d |zd z} d | z} |r d | n | | | gdtfd|Dr2| dvrd|vr| d|S)Nz(.*?)_compiler(_version)?$rz&\{\s*compiler\([\'\"]%s[\"\'][^\{]*?\}c$g|] }|vs|v | SrHrH)rIline compiler_langrs rLrz/find_used_variables_in_text..s2dmt>S>S>S>S>SrNcDg|]}|ddv|S)r=_)replace)rIr2rs rLrz/find_used_variables_in_text..s8dll36L6L1L1L1L1L1LrNz[-_]r5z-\{\s*(?:pin_[a-z]+\(\s*?['\"])?%s[^'\"]*?\}\}z/^[^#\[]*?\#?\s\[[^\]]*?(?!\]]z(?:^|[^\{])\{%\s*(?:el)?if\s*.*z\s*(?:[^%]*?)?%\}z^\s+\-\s+%s\s*(?:\s[\[#]|$)r|c3BK|]}tj|VdSr)research)rIr2all_ress rLrtz.find_used_variables_in_text..s/BBDry$''BBBBBBrN) c_compiler cxx_compilerCONDA_BUILD_SYSROOT)r splitlinesr9matchrescaperrmaprinsertrr+r{)rX recipe_textselectors_onlyused_variables recipe_linescompiler_matchcompiler_regex variant_linesv_regex v_req_regex variant_regexselector_regexconditional_regexrequirement_regexr;r3rs @@@rLfind_used_variables_in_textrQsUUN))++L %>%>"?CC  . *0033MFJJN NN> * * *!-MM!-M  )A,,kk#bi">">?? H7R KgU . 8;O O ;[H  R NN1n - - - - NNM+<>OP Q Q Q))G$$ BBBBMBBB B B >   q ! ! !222(G33"&&'<=== rNc2t|5}|}dddn #1swxYwYt}|D]J}d|z}tj||tjtjzr||K|S)Nz(^[^$]*?\$\{?\s*%s\s*[\s|\}])flagsrfrgrr9r: MULTILINEDOTALLr{rX file_pathrmtextrFrrMs rL#find_used_variables_in_shell_scriptr[s iAvvxxUUN ""81< 9]D ry0H I I I "   q ! ! !  155c8t|5}|}dddn #1swxYwYt}|D]M}d|zdz}tj||tjtjzr||N|S)Nz\%rSrUrXs rL#find_used_variables_in_batch_scriptr^ s iAvvxxUUN "" E) 9]D ry0H I I I "   q ! ! ! r\)NNNT)T)NN)NNN)F):__doc__os.pathrr9sys collectionsrr functoolsr itertoolsrrhconda_interfacer r utilsr r r rrversionrrP version_infomajorminorr[rYrOrsplit arch_namerrUr_rprrrrrrrrrrrr dict_of_lists_to_list_of_dictsrrr%r'r/rQr[r^rHrNrLrns\)) ###### 33333333KKKKKKKKKKKKKK,,,,,,!'BB#*:*@BB  c# 2A2 ''  (ee5'#66#66'1 09J         '  ,   7  D FM#q ! !" %         4(   4 4 4 n...dJNllll^>"TTT0CCCC"UUUU,////.( 4DDDP"2///d    @6IIII" 4))))XrN