&edZddlmZddlmZddlmZddlZddlmZddl m Z m Z edgd Z d Z dd e e efd Zdd ZddedefdZdS)zToken-related utilities) namedtuple)StringIO) iskeywordN) TokenInfo)ListOptionalToken)tokentextstartendlinec#nK tj|D]}|VdS#tj$rYdSwxYw)z'wrap generate_tkens to catch EOF errorsN)tokenizegenerate_tokens TokenError)readliner s 7lib/python3.11/site-packages/IPython/utils/tokenutil.pyrrs_-h77  EKKKK    s !44extra_errors_to_catchc# Kgd}|t|tsJ||pgz}g} tj|D]}|||VdS#tj$r t fd|Drc|r6|djd|djdf}|}|dj }ndx}}d}tj tj d|||VnYd dSd wwxYw)N)zunterminated string literalzinvalid non-printable characterz!after line continuation characterc36K|]}|jdvVdS)rN)args).0errorexcs r z/generate_tokens_catch_errors..,s.AAu #AAAAAAr)r) isinstancelistrrappendranyr r rr ERRORTOKEN) rrdefault_errors_to_catcherrors_to_catchtokensr r r rrs @rgenerate_tokens_catch_errorsr)sd ! (J7Ld,S,S ( ( (-1F1L"MO F-h77  E MM% KKKK        AAAAAAA A A  r (+VBZ^A->>bz$$$X%8"eS$OO O O O O  P O O O O O s0AC6,A?C11C6cd}|d}|D]8}|t|z}|ds|dz }||krn|}9d}||fS)aReturn the line in a cell at a given cursor position Used for calling line-based APIs that don't support multi-line input, yet. Parameters ---------- cell : str multiline block of text cursor_pos : integer the cursor position Returns ------- (line, offset): (string, integer) The line with the current cursor, and the character offset of the start of the line. rT rr ) splitlineslenendswith)cell cursor_posoffsetlinesr next_offsets rline_at_cursorr4:s"F OOD ! !E  s4yy( }}T""  1 K  # # E &>rr/r0c&g}g}g}ddi}tt|jD]}t|}|j\}} |j\} } | dz|vrU|jd} t| |dzD]'\} }| |vr|| dz t|z|| <(||}| dkr|dzn|}|| z|krn4|j tj krut|jsa|rD|rB|dj tjkr'|djdkr|dd|j|d<n||jn|j tjkrm|jdkr|r|d|jdkr|r||dn"|jdkr|r|d|||| | z|krn|r|dS|r|dSd S) avGet the token at a given cursor Used for introspection. Function calls are prioritized, so the token for the callable will be returned if the cursor is anywhere inside the call. Parameters ---------- cell : str A block of Python code cursor_pos : int The location of the cursor in the block where the token should be found rrTr.=()r )rrrr r r rr, enumerater-r rNAMErr OPr#pop)r/r0namesr( call_namesoffsetstuptok start_line start_colend_lineend_colr2linenorr1boundarys rtoken_at_cursorrI\s]EFJ!fGx~~677))Sk!$  IG' a> I  ) ) E 9 % %i.A.A % ' 'F2J$4 $C$Cr [^H^H^',Ryyy#((;b  SX&&&& Y(+ % %x35 " x35!!%),,,,SZr""" c 8 w & 3 3 E 4"~ Ryrr)N)r)__doc__ collectionsriorkeywordrrrtypingrrr rstrr)r4intrIrrrRs #"""""!!!!!!!!  7EEEFF<@%-d3i%8>DDD#D3DDDDDDr