HR-e)9dZddlZddlZddlZddlmZddlmZdZ dZ ddgZ d Z d Z d Zdd ZdZ ddZdZdS)z This package contains functions for reading and writing HDF5 tables that are not meant to be used directly, but instead are available as readers/writers in `astropy.table`. See :ref:`astropy:table_io` for more details. N)AstropyUserWarning)NOT_OVERWRITING_MSGsHDF  __table_column_meta__read_table_hdf5write_table_hdf5c|dztzS)N.)META_KEYpaths 4lib/python3.11/site-packages/astropy/io/misc/hdf5.py meta_pathrs #:  cLddlgfd}||S)z5 Find all structured arrays in an HDF5 file. rNct|jr'|jjdkr|dSdSdS)NV) isinstanceDatasetdtypekindappend)nameobjh5pystructured_arrayss r append_structured_arraysz=_find_all_structured_arrays..append_structured_arrays$sO c4< ( ( +SY^s-B-B  $ $T * * * * * + +-B-Br)r visititems)handlerrrs @@r _find_all_structured_arraysrsPKKK++++++ ./// rcz|e|} |d}||n#||wxYw|tkS||dS ddl}t |d|j|j|j fS#t$rYdSwxYw)N)z.hdf5z.h5rF) tellreadseekHDF5_SIGNATUREendswithrrFileGroupr ImportError)originfilepathfileobjargskwargsloc signaturers r is_hdf5r1,sllnn  QI LL    GLL    N**    !1222J $q'DItz4<#HIII uusAAB,, B:9B:Tc ddl}n#t$rtdwxYw|}t||j|jfr|2 ||}n(#t tf$rtd|dwxYwt||jrt|}t|dkrtd|t|dkrZ||dn |dz|dz}t|dkrtj d |d tt|| Snt||jst!|d r& |j}n#t$$rt'd wxYw||d} t||||S#|wxYwddlm}m}m} |t3j|} t6|jv} |duot;||v} | s| r| r3|d|t;|D} n/|d|jt6D} dt?| vr | d| _d| dD}| j!"D]8}dD]3}|||jvr"tG||||j|49| $| } n| j%|j|s| &| S)a" Read a Table object from an HDF5 file. This requires `h5py `_ to be installed. If more than one table is present in the HDF5 file or group, the first table is read in and a warning is displayed. Parameters ---------- input : str or :class:`h5py.File` or :class:`h5py.Group` or :class:`h5py.Dataset` If a string, the filename to read the table from. If an h5py object, either the file or the group object to read the table from. path : str The path from which to read the table inside the HDF5 file. This should be relative to the input file or group. character_as_bytes : bool If `True` then Table columns are left as bytes. If `False` then Table columns are converted to unicode. rN-h5py is required to read and write HDF5 fileszPath z does not existzno table found in HDF5 group /z`path= was not specified but multiple tables are present, reading in first available table (path=)r r#z h5py can only open regular filesr)r character_as_bytes)Tablemeta serializec3@K|]}|dVdSutf-8Ndecode.0hs r z"read_table_hdf5..?//&'!!//////rc3@K|]}|dVdSr=r?rAs r rDz"read_table_hdf5..rErr:c i|] }|d| S)r)rBxs r z#read_table_hdf5..s@@@qy!@@@rdatatype) descriptionformatunitr:)'rr) Exceptionrr'r(KeyError ValueErrorOSErrorrlenwarningswarnrrrhasattrrAttributeError TypeErrorclose astropy.tabler9r:r;nparrayr attrsrget_header_from_yamllistkeyscolumnsvaluessetattr_construct_mixins_from_columnsupdateconvert_bytestring_to_unicode)inputr r8r input_savearraysfr9r:r;tableold_version_metanew_version_metaheader header_colscolattrs r rr?s*I IIIGHHHIJ%$)TZ0111   =d j) = = =;d;;;<<< = eTZ ( ( 9077F6{{a !G!G!GHHHVq$(LvayydSj6!96Lv;;??M0(,000+  'u48888 t| , , 5& ! ! D D ! D D D BCCC D IIeS ! ! "14DVWWW GGIIIIAGGIIII 5444444444 E"(5// " "E 5;.4'IIdOOz,I'+'  ..//+5ioo+F///FF ..//+0;x+@///F T&++--(( ( (EJ@@VJ-?@@@ ='')) D DCA D D;sx000C{38'>Fc ddlm} ddl} n#t$rt dwxYw|d}n$|drt dd|vr|dd\} } nd|} } t|| j | j frtt| dkr| dkrt d | dkrtjd || r7 || } n #t t f$r|| } YnwxYw|} nt|t$rt&j|r<|s:|r|st'j|n!t/t1j|| ||rd nd } t5|| ||||| | S#| wxYwt9d| | vr*|r|r| | =|r | dz| vr| | dz=nt/d|dt;|}t=d|Dr*| d}|!|durP|D];}dD]6}tE|j#|ddifvrtjdtH7<|r*|durd}| j%| f|&|d|}n"| j%| fd|&i|}|rY|'|}tQj)d|D}| %tU| |dS|jD]X}|j|} ||j+|<#t8$r1tjd|dtY|dtHYUwxYwdS) a Write a Table object to an HDF5 file. This requires `h5py `_ to be installed. Parameters ---------- table : `~astropy.table.Table` Data table that is to be written to file. output : str or :class:`h5py.File` or :class:`h5py.Group` If a string, the filename to write the table to. If an h5py object, either the file or the group object to write the table to. path : str The path to which to write the table inside the HDF5 file. This should be relative to the input file or group. If not specified, defaults to ``__astropy_table__``. compression : bool or str or int Whether to compress the table inside the HDF5 file. If set to `True`, ``'gzip'`` compression is used. If a string is specified, it should be one of ``'gzip'``, ``'szip'``, or ``'lzf'``. If an integer is specified (in the range 0-9), ``'gzip'`` compression is used, and the integer denotes the compression level. append : bool Whether to append the table to an existing HDF5 file. overwrite : bool Whether to overwrite any existing file without warning. If ``append=True`` and ``overwrite=True`` then only the dataset will be replaced; the file/group will not be overwritten. serialize_meta : bool Whether to serialize rich table meta-data when writing the HDF5 file, in particular such data required to write and read back mixin columns like ``Time``, ``SkyCoord``, or ``Quantity`` to the file. **create_dataset_kwargs Additional keyword arguments are passed to ``h5py.File.create_dataset()`` or ``h5py.Group.create_dataset()``. r)r:Nr3__astropy_table__r4z,table path should end with table name, not /r5zUtable path should always be set via the path= argument when writing to existing fileszBtable path was not set via the path= argument; using default path aw)r compressionr overwriteserialize_metaz9output should be a string or an h5py File or Group objectz.__table_column_meta__zTable z already existsc3@K|]}|jjjdkVdS)UN)inforr)rBrps r rDz#write_table_hdf5..Qs. B B#38> # % B B B B B BrF) copy_data)rNrMrLr:ztable contains column(s) with defined 'unit', 'format', 'description', or 'meta' info attributes. These will be dropped since serialize_meta=False.Tgzip)datar~rc8g|]}|dS)r>)encoderAs r z$write_table_hdf5..ts$"J"J"J188G#4#4"J"J"Jr)rz Attribute `z ` of type zm cannot be written to HDF5 files - skipping. (Consider specifying serialize_meta=True to write all meta data))-rZr:rr)rOr&rQrsplitrr'r(rSr_r`rTrUrP create_groupstrosr existsremoverRrrMrrYrXryanyitercolscopyconvert_unicode_to_bytestringgetattrrrcreate_datasetas_arrayget_yaml_from_tabler[r\rr]type)rkoutputr r~rrrcreate_dataset_kwargsr:rgroupr output_grouprjrprqdset header_yamlheader_encodedkeyvals r rrsa\#"""""I IIIGHHHI |" s  IGHHH d{{kk#q)) ttDt&49dj122.U tFKKMM"" # #a ' 'D4G,G,G  ( ( ( M-&*--     " :%e} j) : : :%22599  :"LL FC U 7>>& ! ! B& B B B &!!!!18@@AAA IIfV4cc 5 5 #'#- GGIIIIAGGIIIISTTT |  :i :T" B$)A"A\"Q"Q (@!@A8488899 9 5 ! !E  B B1A1A B B BBB. U ++ ++--- >>##  CA  38T400r BBMB+    $   K*|*  !!#  $   +|*   ~~'' +@  ..u55 "J"Jk"J"J"JKK##IdOO.#IIIII:  C*S/C "% 3    B#BBcBBB'    s8 '8D&D+*D+<G&&G<4 N??8O:9O:cddlm}ddlm}|d|t |d|t|d|tdS)z) Register HDF5 with Unified I/O. r)registry)r9rtN) astropy.iorrZr9register_readerrregister_writerrregister_identifierr1) io_registryr9s r register_hdf5rsw322222######???/?@@@##FE7;;;;;r)NT)NFFFF)__doc__rrTnumpyr[astropy.utils.exceptionsrastropy.utils.miscrr%r __all__rrr1rryrrrHrr rs  877777222222% " 0 1!!!    JJJ&@@@@F   $  uuuup < < < <