o Nrf_*@szddlZddlZddlZddlZddlZddlmZddej fddZ ddZ dd Z d d Z d d ZddZddZdS)N)g.AcCsBddlm}t|rt|t|d}d}t|}d|} t t ||t d} |j dddd } || j d <|| j d <|| j d <| | j d <|d| | j d<|||} |||} |||}td| |D]}|jdt|t|fddd}|jdt|t|fddd}|jdt|t|fddd}||||| ||| |t|| dkr|||dg| t|| f}|| | dg| t| | f} || | dg| t| | f} ||}||} ||} |||d| i}|tj| d| i} |tj| d| i} ql|dS)a Downsample a dataset so that it's compatible with HiGlass (filetype: hitile, datatype: vector) Parameters ---------- old_data: np.array A numpy array containing the data to be downsampled filename: string The output filename where the resulting multi-resolution data will be stored. zoom_step: int The number of zoom levels to skip when aggregating rNwimeta)f)dtype tile-size zoom-step max-lengthmax-zoomz max-widthvalues_gzip)r compressionmins_maxs_)Z dask.arrayarrayopexistsosremoveh5pyFilelenmathceillogZcreate_datasetattrsZ from_arrayrangeZrequire_datasetstrstore concatenateZrechunkZcoarsennpminmaxclose)Zold_datafilename zoom_stepchunksZ agg_functiondaZf_new tile_sizemax_posZ zoom_factormax_zoomrZmin_dataZmax_datazZ values_dsetZ mins_dsetZ maxs_dsetr/]/var/www/html/software/conda/envs/catlas/lib/python3.10/site-packages/clodius/tiles/hitile.pyarray_to_hitile s`                 r1cCXt||dkrt||dg|t||f}|tt|||fjddSNrrr)Zaxis)rr#r"reshaperrsuma num_to_aggr/r/r0 aggregaten$$r9cCr2r3)rr#r"r4rrr$r6r/r/r0 aggregate_minur:r;cCr2r3)rr#r"r4rrr%r6r/r/r0 aggregate_max|r:r<cCs |d|krtdgggfS|dkrtdgggfS|d}t|jd}t|jd}t|jd}|d|}d |jvrHt|jd }n|}||} |t| |} | | } d| } || } t|d| |}t|| }t|d| }|d tt| }|d tt| }|d tt| }||krt||}|tj t||}|tj t |t| }t |t| }nz||kr||kr|||d d }tj ||d|<|||d d }tj ||d|<|||d d }tj ||d|<t |t| }t |t| }t |t| }n!t |||t| }t |||t| }t |||t| }d }dtt| |vr|dtt| }t |||t| }d||}tt |}||||}||}|||fS|||fS)z Return a tile from an hdf_file. :param hdf_file: A file handle for an HDF5 file (h5py.File('...')) :param z: The zoom level :param x: The x position of the tile rzOUT OF RIGHT RANGErzOUT OF LEFT RANGErr r r z max-positionr rrNrZ nan_values_)printintrrfloorr r#Zzerosfillnanr9r;r<r)hdf_filer.xdr+r(r- max_widthZ max_positionZrzZnext_stored_zoomZ zoom_offsetr8Ztotal_in_length start_posend_posrZf_minZf_maxr7Za_minZ ret_arrayZ min_arrayZa_maxZ max_arrayZf_nanZ nan_arrayZnum_aggregatedZnum_vals_arrayZnum_summed_arrayZaverages_arrayr/r/r0get_datasp             rHc Cst|d}|d}d|jvr|jd}nd}d|jvr"|jd}n|jd}t|gt|gdtt||tdt|jdt|jd d S) aI Get the tileset info for a hitile file. Parameters ---------- hitile_path: string The path to the hitile file Returns ------- tileset_info: {'min_pos': [], 'max_pos': [], 'tile_size': 1024, 'max_zoom': 7 } rrzmin-posrzmax-posr rr r )r,min_posrEr-r+)rrrr>rrr)Z hitile_pathrBrDrJr,r/r/r0 tileset_infos         rKc Csg}|D]L}|d}ttt|dd}tt||d|d\}}} t| d dt| d dt| d ddd} ||| fg7}q|S)a Generate tiles from a hitile file. Parameters ---------- tileset: tilesets.models.Tileset object The tileset that the tile ids should be retrieved from tile_ids: [str,...] A list of tile_ids (e.g. xyx.0.0) identifying the tiles to be retrieved Returns ------- tile_list: [(tile_id, tile_data),...] A list of tile_id, tile_data tuples .rrZfloat32zutf-8)denseminsmaxsr) splitlistmapr>rHrrbase64 b64encodeZastypedecode) filepathZtile_idsZgenerated_tilesZtile_idZ tile_id_partsZ tile_positionrNrOrPZ tile_valuer/r/r0tiless  rX)rTrrnumpyr#rZos.pathpathrr5r1r9r;r<rHrKrXr/r/r/r0s  es (