+d |ddlZddlZddlmZddlmZddlmZmZddl m Z m Z ddl m Z Gd d eZd ZdS) N)urljoin) __version__) DataSourceSchema) pack_kwargs unpack_kwargs) serializerc@eZdZdZeZdfd ZdZdZdZ dZ xZ S) RemoteSourcez9Base class for all DataSources living on an Intake serverNc tt||||_||_||_||_d|_|pi|_| dS)a Parameters ---------- url: str Address of the server headers: dict HTTP headers to sue in calls name: str handle to reference this data parameters: dict To pass to the server when it instantiates the data source metadata: dict Additional info kwargs: ignored N) superr __init__urlname parametersheaders _source_idmetadata_get_source_id)selfrrrrrkwargs __class__s 5lib/python3.11/site-packages/intake/container/base.pyrzRemoteSource.__init__si" lD!!**4000 $  B  c \|jtd|j|j}t jt |jdfdtj |fiti|j }| tj |jfit}||dSdS)Nopen)actionrr v1/sourcedata)rdictrrrequestspostrrmsgpackpackbrrraise_for_statusunpackbcontentr _parse_open_response)rpayloadreqresponses rrzRemoteSource._get_source_id2s ? 0&tyT_UUUG-+ > >{{W]SZEjEj^iEjEj{nrnz{{C  " " "s{DDmDDH  % %h / / / / /  0 0rcR|d}t|trd|dD}||_t|dpd|_|d|_|d|_td|j|j|j|j|_|d|_ dS) Ndtypec,g|]}t|S)tuple).0xs r z5RemoteSource._parse_open_response..>s???588???rshaper1 npartitionsr) datashaper/r6r7r source_id) isinstancelistr/r2r6r7rr_schemar)rr- dtype_descrs rr*z!RemoteSource._parse_open_response:sw' k4 ( ( @??Xg->???K  8G,233 #M2 , DJdj^b^ny}zGHHH ";/rctNNotImplementedError)ris r_get_partitionzRemoteSource._get_partitionF!!rctr?r@)rs rto_daskzRemoteSource.to_daskIrDrr?) __name__ __module__ __qualname____doc__rversionrrr*rCrF __classcell__)rs@rr r sCCG4000 0 0 0""""""""""rr c ttj}ttj}t d|||}|||d< t jt|dfdtj |fiti|}|j dkrtdtj|jfit } | d } | d } tj| } tj| } | | | d|}|||SS#||wwxYw) aSerializable function for fetching a data source partition Parameters ---------- url: str Server address headers: dict HTTP header parameters source_id: str ID of the source in the server's cache (unique per user) container: str Type of data, like "dataframe" one of ``intake.container.container_map`` partition: serializable Part of data to fetch, e.g., an integer for a dataframe. read)rr9accepted_formatsaccepted_compressionN partitionr r!zError reading dataformat compression)r;r format_registrykeyscompression_registryr"r#r$rr%r&r status_code Exceptionr(r)r decode decompressclose)rrr9 containerrQrOrPr+respmsgrSrT compressorencoderchunks r get_partitionrcMs| J6;;==>> ? D D F FGG&IHXpDEEEG)( }WS+66nnW]7=b=bVa=b=bnfmnn  s " 2011 1odl<ris######11111111////////7"7"7"7"7":7"7"7"t%%%%%r