0Fie@< ddlmZddlZddlZddlZddlmZddlmZm Z ddl m Z m Z m Z mZmZmZmZddlmZmZddlmZddlmZdd lmZdd lmZmZdd lmZm Z dd l!m"Z"m#Z#dd l$m%Z%ddl&m'Z'm(Z(m)Z)m*Z*ddl+m,Z,m-Z-m.Z.ddl/m0Z0ddl1m2Z2ej3e4Z5eeej67ej68e9ddddZ:eej67ej68e9ddZ;dgdiZGdd e'Z?Gd!d"e'Z@Gd#d$e'ZAGd%d&e'ZBe=d'd()d*ZCe=d+d,)d-ZDe=d.d/)d0ZEe=d1d2)d3ZFe=d4d)d5ZGdS)6) annotationsN)without_property_validation)columnrow)ColumnDataSource DataRange1d HoverToolNumeralTickFormatterPanTool ResetTool WheelZoomTool) DataTable TableColumn)RdBu)figure)Theme) EnvironmentFileSystemLoader)merge partition_all) format_bytes format_time)add_periodic_callback)DashboardComponent ProfileServerProfileTimePlot SystemMonitor)_DATATABLE_STYLESHEETS_KWARGS transposeupdate)time log_errorsz..http templates)loaderz theme.yaml)filenamepages)statussystemprofilez simple.html)templatecfd}|S)NcFtdfd}|S)N) unroll_stackc|_t|_ |jd<|j|t |_|||S)N active_page)titleenv get_templater,template_variablesr BOKEH_THEMEtheme)argextradocr2fr,r3s Glib/python3.11/site-packages/distributed/dashboard/components/worker.pywrapperz0standard_doc..decorator..wrapper6sdCI++H55CL&8C&}5  " ) )% 0 0 0#CI1S%%% %r")r<r>r2r,r3s` r= decoratorzstandard_doc..decorator5sI  # # # & & & & & & & $ # &r?)r3r2r,r@s``` r= standard_docrB4s0        r?c>eZdZdZdZeedZdS) StateTablezCurrently running tasksc||_gd}td|D|_d|Dtd|jfd|Dddt}||_dS)NStored ExecutingReadyWaiting ConnectionsServingci|]}|gSrArA.0names r= z'StateTable.__init__..Ls'C'C'CTb'C'C'Cr?c2i|]}|t||S))fieldr3)rrNs r=rQz'StateTable.__init__..Ns'OOO44t<<<OOOr?c g|] }| SrArA)rOncolumnss r= z'StateTable.__init__..Rs///AWQZ///r?F)sourcerVheightrA)workerrrYrrroot)selfr[namestablerVs @r=__init__zStateTable.__init__Hs UUU&'C'CU'C'C'CDD OOOOO ;///////  ,     r?cF|j}t|jgd|jj|jjfzgt|jjgt|jjg|jjgt|j gd}t|j |dS)Nz%d / %drF) r[lendatastateexecuting_countnthreadsreadywaitingtransfer_incoming_count_commsr rY)r]wds r=r zStateTable.updateXs K16{{m#qw'>@P&QQR!'-(()AGO,,-G;<AH     t{Ar?N)__name__ __module__ __qualname____doc__r`rr#r rAr?r=rDrDEsO!! !  Z!    r?rDcLeZdZeddZeedZdS)CommunicatingStream,c p||_gd}td|D|_td|D|_t d}t d}t ddd|||dd |}||jd d d d dd||jd d d d ddtdd}||ttdtd||_ d|_ d|_t|_dS)N) startstopmiddledurationwhoyhoveralpha bandwidthtotalci|]}|gSrArArNs r=rQz0CommunicatingStream.__init__..x2N2N2N42N2N2Nr?ci|]}|gSrArArNs r=rQz0CommunicatingStream.__init__..yrr?r) range_paddingzPeer Communicationsdatetime)r3 x_axis_typex_rangey_rangerZtoolsrwrzrxg?redr|)rYxrzwidthrZcolorr|blue follow_mousez@hover point_policytooltipsr dimensionsrA)r[rtransfer_incomingtransfer_outgoingrrrectr add_toolsr r r r\"last_transfer_incoming_count_total"last_transfer_outgoing_count_totaldictry) r]r[rZkwargsr^rrfigr{s r=r`zCommunicatingStream.__init__hs     "22N2N2N2N2N!O!O!12N2N2N2N2N!O!OA...A... '"      )     )    ~ MMM  KK w ' ' ' W - - -     23/23/66r?c  |jj |jj|jz } fdt d|dzD |jj|_|jj|jjj|jz }fdt d|dzD|jjj|_|j g |j gfD]\}}|D]}d|vr|d=|d=|d|dpdz }tt|d z dd }||d < |j |d |d <nH#t$r;t|j |j |d <|j |d |d <YnwxYwdt#|dt%|dt#|d|dz |d<dD]}||dz||<|rt'|}t|jdrIt|d|jdddzkr|j|||ddS)NcFg|]}| SrAcopy)rOitransfer_outgoing_logs r=rWz.CommunicatingStream.update..:! ! ! 12 !1" % * * , ,! ! ! r?r/cFg|]}| SrAr)rOrtransfer_incoming_logs r=rWz.CommunicatingStream.update..rr? compressedkeysr~rx?geͽA333333?r|ryrzz{} / {} = {}/sr{)rwrxrurvrvru')rollover)r[rtransfer_outgoing_count_totalrrangerrdtransfer_incoming_count_totalrrrmaxminryKeyErrorrbformatrrrrcr stream) r]rUmsgsrYmsgr}bwkrrs @@r=r zCommunicatingStream.updates!% A K 55 6 ! ! ! ! 6;Aq1uoo! ! !  K 5 /!% A K  ;5 6 ! ! ! ! 6;Aq1uoo! ! !  K  ; / #D$: ; "D$: ; # 8# 8NT6 + +3&&L)KLC O,BsC Y.22C88!G 4#xE 3CHH444+.tx==DHSZ(#xE 3CHHH4 066 W..J00 WJ!?@@  G A++A Vd]CFF+ 8  F+,,8DM**V[-@-Du-LLLK&&t,,,,MM$M777G# 8# 8sD%%AE*)E*N)rs)rmrnror#r`rr rAr?r=rrrrgsY>>>Z>@!<8<8Z! <8<8<8r?rrc:eZdZdZeedZdS)CommunicatingTimeSeriesc ||_tgggd|_tddd}t dddd|jjd zgd d |d |}||jd dd||jd dd|ttdtd||_ dS)N)rinoutend Nrfollowfollow_intervalrzCommunication Historyr皙rrr3rrrZrrrrr)rYrrzrrrrrrA) r[rrYrrrdtransfer_incoming_count_limitlinerr r r r\r]r[rrrs r=r`z CommunicatingTimeSeries.__init__s &Rr"'E'EFF UEQRSSS )"6<EKL       sd%@@@  se6BBB KKG444mw6W6W6W    r?c|jtdzgt|jjg|jjjgdddS)Nr)rrrr)rYrr!rbr[rjrdrir]s r=r zCommunicatingTimeSeries.updatese fftm_DK.//0{(@A         r?Nrmrnror`rr#r rAr?r=rrsI0!  Z!    r?rc:eZdZdZeedZdS)ExecutingTimeSeriesc p||_tggd|_tddd}t dddd|jjd zgd d |d |}||jd d|ttdtd||_ dS)NrrzrrrrzExecuting Historyrrg?rrrrrz)rYrrzrrrA) r[rrYrrrdrfrrr r r r\rs r=r`zExecutingTimeSeries.__init__s &Rb'9'9:: UEQRSSS %"6<0367       sc222 KKG444mw6W6W6W    r?c|jtdzg|jjjgdddS)Nrr)rYrr!r[rdrers r=r zExecutingTimeSeries.update(sJ 66D=/):)J(K L Ld     r?NrrAr?r=rrsI.!  Z!    r?rcheZdZddZedZedZeedZdS)Counters stretch_bothc ||_i|_i|_i|_i|_|_|jjr$|jjD]}|||jjD]}| |t|j|jfdtDtdkrt|_dStfdtdDdi|_dS)Nc g|] }| SrArA)rOrfiguress r=rWz%Counters.__init__..@s777!71:777r? sizing_modec30K|]}t|diVdS)rN)r)rOpairrs r= z$Counters.__init__..FsD7;77r?r)servercounter_figurescounter_sourcesdigest_figuresdigest_sourcesrdigestsadd_digest_figurecountersadd_counter_figurersortedrbrr\r)r]rrrrPrs ` @r=r`zCounters.__init__1sB !!  & ;  - + - -&&t,,,,K( * *D  # #D ) ) ) )+T-ABB7777vg777 w<<1  wK@@@DIII -a 9 9 ( DIIIr?c t|jj|j}dt |D}i}|drd|d<t d|dd|jd|}d|j_ d|j _ |d s|d r td |j d _ t |D]P}dd||z z|z z}|||dd|tt!|d| Qt"jdz |j _||j|<||j|<|S)Nc4i|]}|tggdS)rrrOrs r=rQz.Counters.add_digest_figure..Ps+MMMq1&Rb'9'9::MMMr?rxrrrr)r3rrZrFr}bytesz0.0b)rrrrrz)rYrrzr|r rA)rbrr intervalsrendswithrryaxisvisibleygridr xaxis formatterrrrmathpimajor_label_orientationrr)r]rPrUsourcesrrrr|s r=rzCounters.add_digest_figureMs  #D)3 4 4MME!HHMMM == $ $ /$.F= ! b$:J  NT  " !  == % % Iw)?)? I%9%H%H%HCIaL "q  A#Q-!++E HHqz3q!99oqb)     -1GbL )$+D!$'D! r?ct|jj|j}dt |D}t |dd|jtd|jj|jdD}d|j _ t |D]}dd |z|z z}| ||d d |d d tt|d| tdd}||t jdz |j_||j|<||j|<|S)Nc 8i|]}|tggggdS)rrzy-centercountsrrs r=rQz/Counters.add_counter_figure..ps?    brrR P PQQ   r?rrc34K|]}t|VdS)NstrrOrs r=rz.Counters.add_counter_figure..zs(TTa3q66TTTTTTr?r)r3rrZrrFrg?rrrzrr)rYrrzrrZr|rrz @x : @countsrr)rbrrrrrrr componentsrrrrrr rrrrrrr)r]rPrUrrrrr{s r=rzCounters.add_counter_figuremse  $T*4 5 5  1XX    (TT4;+?+E+PQR+STTTTT    " q = =A#'A+%E HHqz3q!99oqb)    >DVWWWE MM% 04" CI - -%,T"%(T" r?c |jD]\}}|jj|}i t |jD]\} rj d\}}|dd}|dr|dz}|j ||j ||dd||fz|j _ |jD]\}}|jj|}i t |jD]\} rt! }|jd|j|z fd|D} fd |D}d |D} d |D}||| |d  |j||j d||fz|j _ d |D|j_ьdS)Ndr/rxrrz%s: %drc g|] }| SrArA)rOrrls r=rWz#Counters.update..s///qad///r?cg|]}|zSrArA)rOcfactors r=rWz#Counters.update..s555&1*555r?cg|]}|dz S)rrA)rOrzs r=rWz#Counters.update..s 3 3 31Q 3 3 3r?c,g|]}t|SrArrs r=rWz#Counters.update..s---Q#a&&---r?rc,g|]}t|SrArrs r=rWz#Counters.update..s&:&:&:!s1vv&:&:&:r?)ritemsrr enumeratersize histogramrrrcr r3textrrrrrrfactors) r]rPrdigestrysxscounterr y_centersrlr s @@r=r zCounters.updatesJ,2244 > >ID#[(.FA!&"344 Q Q16688Q[[--FBABBB}}Z00#d '-a05<<2B=O=OPPP%v{{}}(==CINN-3355 ; ;ID#k*40GA!'"455 ; ;1AB$.q1G4Ea4HHF////B///F5555f555B 3 3 3 3 3I--"---B ryFSSA(.q16==a@@@!)T7<<>>,B!B &:&:r&:&:&: ## ; ; ;r?N)r) rmrnror`r#rrrr rAr?r=rr0s8Z>!!Z!F!;;Z! ;;;r?rzDask Worker Internal Monitorr))r2c t|}t|d}t|d}t|d}|jj}||j_||j_t ||dt ||dt ||dt ||d|t|j|j|j|jddS)N scale_widthr) rDrrrrr\rradd_rootr)r[r:r; statetable executing_tscommunicating_tscommunicating_streamxrs r= status_docr"sF##J&v=IIIL.v=QQQ.v=QQQ   "B$&!(*%#z3///#|S111#/555#3S999LL O    ! %%    r?zDask Worker Monitorr*c~t|d}t||d||jdS)Nrr)rrrr\)r[r:r;sysmons r=systemmonitor_docr&s@ 6} = = =F#vs+++LLr?zDask Work Countersrc~t|d}t||d||jdS)Nrrr$)rrrr\)rr:r;rs r= counters_docr(s@v>:::G#w,,,LLr?zDask Worker Profiler+ct|d|}||j|dSNr)rr;)rrr\trigger_updaterr:r;r+s r= profile_docr-sBf.cJJJGLL r?zDask: Profile of Event Loopct|d|}||j|dSr*)rrr\r+r,s r=profile_server_docr/sBFCHHHGLL r?)H __future__rloggingrosbokeh.core.propertiesr bokeh.layoutsrr bokeh.modelsrrr r r r r bokeh.models.widgetsrrbokeh.palettesrbokeh.plottingr bokeh.themesrjinja2rrtlzrr dask.utilsrr distributed.dashboard.componentsr'distributed.dashboard.components.sharedrrrrdistributed.dashboard.utilsrrr distributed.metricsr!distributed.utilsr# getLoggerrmloggerpathjoindirname__file__r4r7r6rBrDrrrrrr"r&r(r-r/rAr?r=rHs"""""" ======%%%%%%%%87777777!!!!!!00000000$$$$$$$$00000000BBBBBB YXXXXXXXXX$$$$$$((((((  8 $ $k    RW__X..dFKPP   e W\\"'//(33T< H H >>>?2?"#D@8@8@8@8@8,@8@8@8F# # # # # 0# # # L     ,   @~;~;~;~;~;!~;~;~;B,(CCCDC2#:::;: " ;;;<; #;;;<; +>>>?>r?